US11197063B2ActiveUtilityA1

Methods, systems, and media for modifying the presentation of video content on a user device based on a consumption of the user device

68
Assignee: GOOGLE LLCPriority: Nov 11, 2016Filed: Nov 11, 2016Granted: Dec 7, 2021
Est. expiryNov 11, 2036(~10.3 yrs left)· nominal 20-yr term from priority
H04N 21/4667H04N 21/4394G06F 16/40H04N 21/439H04N 21/44204G06F 16/738
68
PatentIndex Score
1
Cited by
7
References
33
Claims

Abstract

Methods, systems, and media for modifying the presentation of video content on a user device based on a consumption mode of the user device are provided. In some embodiments, a computer-implemented method comprises: receiving, from a user device, a request to present a video content item, wherein the video content item includes an audio portion; identifying a segment of the audio portion as including a particular type of audio content (e.g., silent content, music content, speech content, theatrical content, non-musical content, etc.); determining a consumption mode associated with the user device; generating a modified video content item based on the consumption mode associated with the user device by removing a portion of the video content item that corresponds to the segment of the audio portion identified as including the particular type of audio content; and causing the modified video content item to be presented on the user device.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A computer-implemented method for presenting video content, the method comprising:
 receiving, from a user device, a request to present a video content item, wherein the video content item includes an audio portion and a video portion; 
 identifying a segment of the audio portion as including a particular type of audio content; 
 determining a consumption mode associated with the user device, wherein the consumption mode being one of a user of the user device listening to the audio portion without viewing the video portion associated with the video content item and the user of the user device viewing the video portion associated with the video content item; 
 in response to determining that the consumption mode indicates that the user of the user device is listening to the audio portion without viewing the video portion associated with the video content item, generating a modified video content item based on the consumption mode associated with the user device by removing corresponding portions of the audio portion and the video portion from the video content item that corresponds to the segment of the audio portion identified as including the particular type of audio content; and 
 causing the modified video content item to be presented on the user device. 
 
     
     
       2. The method of  claim 1 , wherein determining the consumption mode associated with the user device is based on user input from a user of the user device. 
     
     
       3. The method of  claim 1 , wherein determining the consumption mode associated with the user device comprises determining whether an application presenting the video content item is executing in the background of the user device, and wherein the modified video content is generated in response to determining that the application is executing in the background of the user device. 
     
     
       4. The method of  claim 1 , wherein the particular type of audio content in the audio portion corresponds to silence. 
     
     
       5. The method of  claim 4 , wherein identifying that the particular type of audio content in the audio portion corresponds to silence comprises determining that a loudness level of the audio portion is below a predetermined threshold level. 
     
     
       6. The method of  claim 1 , wherein the particular type of audio content in the audio portion corresponds to speech. 
     
     
       7. The method of  claim 1 , further comprising:
 determining that the modified video content item is not to be presented based on the consumption mode associated with the user device; and 
 storing the modified video content item in response to determining that the modified video content item is not to be presented. 
 
     
     
       8. The method of  claim 1 , further comprising calculating a confidence value associated with the consumption mode, wherein the modified video content item is generated in response to determining that the confidence value is greater than a predetermined threshold. 
     
     
       9. The method of  claim 1 , further comprising causing a second video content item to be presented on the user device, wherein the removed portion of the video content item corresponds to silent audio content at an ending portion of the video content item. 
     
     
       10. The method of  claim 1 , wherein the identified segment of the audio portion corresponds to an intermediate portion of the video content item, and wherein the particular type of audio content is non-musical audio content. 
     
     
       11. The method of  claim 1 , wherein the segment of the audio portion is identified based on an output of a classifier, and wherein the output of the classifier is based on manually classified training data from a plurality of content segments. 
     
     
       12. A system for presenting video content, the system comprising:
 a memory storing computer-executable instructions; and 
 a hardware processor that, when executing the computer-executable instructions stored in the memory, is configured to:
 receive, from a user device, a request to present a video content item, wherein the video content item includes an audio portion and a video portion; 
 identify a segment of the audio portion as including a particular type of audio content; 
 determine a consumption mode associated with the user device, wherein the consumption mode being one of a user of the user device listening to the audio portion without viewing the video portion associated with the video content item and the user of the user device viewing the video portion associated with the video content item; 
 in response to determining that the consumption mode indicates that the user of the user device is listening to the audio portion without viewing the video portion associated with the video content item, generate a modified video content item based on the consumption mode associated with the user device by removing corresponding portions of the audio portion and the video portion from the video content item that corresponds to the segment of the audio portion identified as including the particular type of audio content; and 
 cause the modified video content item to be presented on the user device. 
 
 
     
     
       13. The system of  claim 12 , wherein determining the consumption mode associated with the user device is based on user input from a user of the user device. 
     
     
       14. The system of  claim 12 , wherein determining the consumption mode associated with the user device comprises determining whether an application presenting the video content item is executing in the background of the user device, and wherein the modified video content is generated in response to determining that the application is executing in the background of the user device. 
     
     
       15. The system of  claim 12 , wherein the particular type of audio content in the audio portion corresponds to silence. 
     
     
       16. The system of  claim 15 , wherein identifying that the particular type of audio content in the audio portion corresponds to silence comprises determining that a loudness level of the audio portion is below a predetermined threshold level. 
     
     
       17. The system of  claim 12 , wherein the particular type of audio content in the audio portion corresponds to speech. 
     
     
       18. The system of  claim 12 , wherein the hardware processor is further configured to:
 determine that the modified video content item is not to be presented based on the consumption mode associated with the user device; and 
 storing the modified video content item in response to determining that the modified video content item is not to be presented. 
 
     
     
       19. The system of  claim 12 , wherein the hardware processor is further configured to calculate a confidence value associated with the consumption mode, wherein the modified video content item is generated in response to determining that the confidence value is greater than a predetermined threshold. 
     
     
       20. The system of  claim 12 , wherein the hardware processor is further configured to cause a second video content item to be presented on the user device, wherein the removed portion of the video content item corresponds to silent audio content at an ending portion of the video content item. 
     
     
       21. The system of  claim 12 , wherein the identified segment of the audio portion corresponds to an intermediate portion of the video content item, and wherein the particular type of audio content is non-musical audio content. 
     
     
       22. The system of  claim 12 , wherein the segment of the audio portion is identified based on an output of a classifier, and wherein the output of the classifier is based on manually classified training data from a plurality of content segments. 
     
     
       23. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for presenting video content, the method comprising:
 receiving, from a user device, a request to present a video content item, wherein the video content item includes an audio portion and a video portion; 
 identifying a segment of the audio portion as including a particular type of audio content; 
 determining a consumption mode associated with the user device, wherein the consumption mode being one of a user of the user device listening to the audio portion without viewing the video portion associated with the video content item and the user of the user device viewing the video portion associated with the video content item; 
 in response to determining that the consumption mode indicates that the user of the user device is listening to the audio portion without viewing the video portion associated with the video content item, generating a modified video content item based on the consumption mode associated with the user device by removing corresponding portions of the audio portion and the video portion from the video content item that corresponds to the segment of the audio portion identified as including the particular type of audio content; and 
 causing the modified video content item to be presented on the user device. 
 
     
     
       24. The non-transitory computer-readable medium of  claim 23 , wherein determining the consumption mode associated with the user device is based on user input from a user of the user device. 
     
     
       25. The non-transitory computer-readable medium of  claim 23 , wherein determining the consumption mode associated with the user device comprises determining whether an application presenting the video content item is executing in the background of the user device, and wherein the modified video content is generated in response to determining that the application is executing in the background of the user device. 
     
     
       26. The non-transitory computer-readable medium of  claim 23 , wherein the particular type of audio content in the audio portion corresponds to silence. 
     
     
       27. The non-transitory computer-readable medium of  claim 23 , wherein identifying that the particular type of audio content in the audio portion corresponds to silence comprises determining that a loudness level of the audio portion is below a predetermined threshold level. 
     
     
       28. The non-transitory computer-readable medium of  claim 23 , wherein the particular type of audio content in the audio portion corresponds to speech. 
     
     
       29. The non-transitory computer-readable medium of  claim 23 , further comprising:
 determining that the modified video content item is not to be presented based on the consumption mode associated with the user device; and 
 storing the modified video content item in response to determining that the modified video content item is not to be presented. 
 
     
     
       30. The non-transitory computer-readable medium of  claim 23 , further comprising calculating a confidence value associated with the consumption mode, wherein the modified video content item is generated in response to determining that the confidence value is greater than a predetermined threshold. 
     
     
       31. The non-transitory computer-readable medium of  claim 23 , further comprising causing a second video content item to be presented on the user device, wherein the removed portion of the video content item corresponds to silent audio content at an ending portion of the video content item. 
     
     
       32. The non-transitory computer-readable medium of  claim 23 , wherein the identified segment of the audio portion corresponds to an intermediate portion of the video content item, and wherein the particular type of audio content is non-musical audio content. 
     
     
       33. The non-transitory computer-readable medium of  claim 23 , wherein the segment of the audio portion is identified based on an output of a classifier, and wherein the output of the classifier is based on manually classified training data from a plurality of content segments.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.