Multi-media summary generation based on meeting discussions

Abstract

Aspects of the disclosure are directed to multi-media summary generation based on meeting discussions. A virtual meeting user interface (UI) can be presented during a virtual meeting between a plurality of participants. A command can be received, via the virtual meeting UI, a from a first participant of the plurality of participants to enable automatic note taking. A meeting summary of the virtual meeting can be generated, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting. The meeting summary can be provided to the first participant.

What is claimed is: 
     
         1 . A method comprising:
 causing a virtual meeting user interface (UI) to be presented during a virtual meeting between a plurality of participants;   receiving, via the virtual meeting UI, a command from a first participant of the plurality of participants to enable automatic note taking;   generating a meeting summary of the virtual meeting, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting; and   providing the meeting summary to the first participant.   
     
     
         2 . The method of  claim 1 , wherein the meeting summary is generated using an artificial intelligence (AI) model and using the media streams generated by the plurality of client devices associated with the plurality of participants as input to the AI model. 
     
     
         3 . The method of  claim 2 , wherein the AI model is trained to generate meeting summaries of virtual meetings using training data comprising media streams generated by a second plurality of client devices associated with a second plurality of participants of past virtual meetings. 
     
     
         4 . The method of  claim 1 , wherein the meeting summary is generated based on a transcript of the virtual meeting, wherein the transcript comprises a second plurality of embedded references, wherein each embedded reference of the second plurality of embedded references identifies at least one corresponding portion of the media streams. 
     
     
         5 . The method of  claim 1 , wherein the meeting summary comprises at least one of:
 one or more action items assigned to respective one or more participants of the plurality of participants;   a list of topics discussed during the virtual meeting;   one or more documents presented via the virtual meeting UI; or   one or more portions of a textual chat presented via the virtual meeting UI.   
     
     
         6 . The method of  claim 1 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, the method further comprising:
 visually rendering the meeting summary;   receiving a user selection of a portion of the meeting summary;   identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of the media streams associated with the selected portion of the meeting summary; and   visually rendering the identified portion of the media streams.   
     
     
         7 . The method of  claim 6 , further comprising:
 visually distinguishing the selected portion of the meeting summary.   
     
     
         8 . The method of  claim 1 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, the method further comprising:
 visually rendering the meeting summary;   receiving a user selection of a portion of the meeting summary   identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of a meeting transcript associated with the selected portion of the meeting summary; and   visually rendering the identified portion of the meeting transcript.   
     
     
         9 . The method of  claim 1 , wherein each embedded reference is a hyperlink that is visually identifiable in a visual rendering of the meeting summary. 
     
     
         10 . The method of  claim 1 , wherein each embedded reference is a visually hidden hyperlink. 
     
     
         11 . A system comprising:
 a memory; and   a processing device, coupled to the memory, configured to perform operations comprising:
 causing a virtual meeting user interface (UI) to be presented during a virtual meeting between a plurality of participants; 
 receiving, via the virtual meeting UI, a command from a first participant of the plurality of participants to enable automatic note taking; 
 generating a meeting summary of the virtual meeting, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting; and 
 providing the meeting summary to the first participant. 
   
     
     
         12 . The system of  claim 11 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
 visually rendering the meeting summary;   receiving a user selection of a portion of the meeting summary;   identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of the media streams associated with the selected portion of the meeting summary; and   visually rendering the identified portion of the media streams.   
     
     
         13 . The system of  claim 12 , wherein the processing device is further configured to perform operations comprising:
 visually distinguishing the selected portion of the meeting summary.   
     
     
         14 . The system of  claim 11 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
 visually rendering the meeting summary;   receiving a user selection of a portion of the meeting summary;   identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of a meeting transcript associated with the selected portion of the meeting summary; and   visually rendering the identified portion of the meeting transcript.   
     
     
         15 . The system of  claim 11 , wherein each embedded reference is a hyperlink that is visually identifiable in a visual rendering of the meeting summary. 
     
     
         16 . A non-transitory computer readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
 causing a virtual meeting user interface (UI) to be presented during a virtual meeting between a plurality of participants;   receiving, via the virtual meeting UI, a command from a first participant of the plurality of participants to enable automatic note taking;   generating a meeting summary of the virtual meeting, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting; and   providing the meeting summary to the first participant.   
     
     
         17 . The non-transitory computer readable storage medium of  claim 16 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
 visually rendering the meeting summary;   receiving a user selection of a portion of the meeting summary;   identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of the media streams associated with the selected portion of the meeting summary; and   visually rendering the identified portion of the media streams.   
     
     
         18 . The non-transitory computer readable storage medium of  claim 17 , wherein the processing device is further configured to perform operations comprising:
 visually distinguishing the selected portion of the meeting summary.   
     
     
         19 . The non-transitory computer readable storage medium of  claim 16 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
 visually rendering the meeting summary;   receiving a user selection of a portion of the meeting summary;   identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of a meeting transcript associated with the selected portion of the meeting summary; and   visually rendering the identified portion of the meeting transcript.   
     
     
         20 . The non-transitory computer readable storage medium of  claim 16 , wherein each embedded reference is a hyperlink that is visually identifiable in a visual rendering of the meeting summary.