P
US11113897B2ActiveUtilityPatentIndex 61

Systems and methods for presentation of augmented reality supplemental content in combination with presentation of media content

Assignee: ROVI GUIDES INCPriority: Oct 30, 2017Filed: Nov 5, 2019Granted: Sep 7, 2021
Est. expiryOct 30, 2037(~11.3 yrs left)· nominal 20-yr term from priority
Inventors:GUPTA VIKRAM MAKAMNEERAKANI HARSHAKALARIA NIMIT DINESHBHAI
H04N 21/43079H04N 21/41265G06V 20/20H04N 21/4722H04N 21/4122H04N 21/4756G06T 19/006H04N 21/4622G09G 2320/028H04N 21/4821H04N 21/4532G06T 19/20G06T 2219/2004H04N 21/4312H04N 21/23418H04N 21/4524H04N 21/47214H04N 21/4307G06K 9/00671H04N 21/4126
61
PatentIndex Score
0
Cited by
5
References
18
Claims

Abstract

Systems and methods are provided herein for providing supplemental Augmented Reality (AR) content. Media content is provided to a user device located within a viewing area. A determination is made that a supplemental three dimensional (3D) AR content related to the media content is available. 3D characteristics of the supplemental AR content are determined. Such characteristics include a viewing angle and body position of an actor from the supplemental AR content. 3D characteristics of the viewing area are determined. Such characteristics include shape and position of the furniture within the viewing area and a position of a user within the viewing area. A position is determined within the viewing area by comparing the 3D characteristics of the supplemental AR content and the 3D characteristics of the viewing area. The supplemental AR content is then provided for display at the determined position.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A method for providing supplemental Augmented Reality (AR) content, the method comprising:
 determining a supplemental three-dimensional (3D) AR figure related to a content item, wherein the supplemental 3D AR figures comprises a representation of an actor's body; 
 identifying furniture within a viewing area, wherein the furniture is not a display screen of a device; 
 determining a first placement position within the viewing area for the supplemental 3D AR figure over the furniture, such that the representation of the actor's body of the supplemental 3D AR figure occupies the furniture, based on shape and position of the furniture within the viewing area, a body position of the representation of the actor's body of the supplemental 3D AR figure, and a first position of the device within the viewing area, wherein determining the first placement position comprises:
 determining, based on a first angle of the first position of the device within the viewing area, the first placement position; and 
 determining, based on a second angle of a second position of the device within the viewing area, a second placement position; and 
 
 providing for display the supplemental 3D AR figure in the first placement position. 
 
     
     
       2. The method of  claim 1 , wherein providing for display the supplemental 3D AR figure in the first placement position comprises providing for simultaneous display a current scene of the content item and the supplemental 3D AR figure. 
     
     
       3. The method of  claim 1 , wherein determining the supplemental 3D AR figure related to the content item comprises determining that a current scene of the content item is related to the supplemental 3D AR figure. 
     
     
       4. The method of  claim 3 , wherein determining that the current scene is related to the supplemental 3D AR figure comprises comparing metadata of the current scene to metadata of the supplemental 3D AR figure. 
     
     
       5. The method of  claim 3 , wherein determining that the current scene is related to the supplemental 3D AR figure comprises determining, based on a timestamp identifying the current scene, that the supplemental 3D AR figure is available at the timestamp. 
     
     
       6. The method of  claim 1 , wherein identifying furniture within the viewing area comprises determining the shape and position of the furniture. 
     
     
       7. The method of  claim 1 , wherein providing for display the supplemental 3D AR figure in the first placement position comprises:
 in response to the device being at the first angle, providing for display the supplemental 3D AR figure in the first placement position; and 
 in response to the device being at the second angle, providing for display the supplemental 3D AR figure in the second placement position. 
 
     
     
       8. The method of  claim 1 , further comprising:
 determining there is no good placement position for the supplemental 3D AR content within the viewing area; and 
 in response to determining there is no good placement position, prompting the user to adjust the position of the furniture within the viewing area. 
 
     
     
       9. The method of  claim 8 , further comprising:
 providing for display an AR phantom outline of the furniture in a preferred position within the viewing area; and 
 prompting the user to align the furniture within the viewing area to the AR phantom outline in the preferred position. 
 
     
     
       10. A system for providing supplemental Augmented Reality (AR) content, the system comprising:
 control circuitry configured to:
 determine a supplemental three-dimensional (3D) AR figure related to a content item, wherein the supplemental 3D AR figure comprises a representation of an actor's body; 
 identify furniture within a viewing area, wherein the furniture is not a display screen of a device; and 
 determine a first placement position within the viewing area for the supplemental 3D AR figure over the furniture, such that the representation of the actor's body of the supplemental 3D AR figure occupies the furniture, based on shape and position of the furniture within the viewing area, a body position of the representation of the actor's body of the supplemental 3D AR figure, and a first position of the device within the viewing area, wherein the control circuitry is configured to determine the first placement position by:
 determining, based on a first angle of the first position of the device within the viewing area, the first placement position; and 
 determining, based on a second angle of a second position of the device within the viewing area, a second placement position; and 
 
 
 output circuitry configured to provide for display the supplemental 3D AR figure in the first placement position. 
 
     
     
       11. The system of  claim 10 , wherein the output circuitry is configured to provide for display the supplemental 3D AR figure in the first placement position by providing for simultaneous display a current scene of the content item and the supplemental 3D AR figure. 
     
     
       12. The system of  claim 10 , wherein the control circuitry is configured to determine the supplemental 3D AR figure related to the content item by determining that a current scene of the content item is related to the supplemental 3D AR figure. 
     
     
       13. The system of  claim 12 , wherein the control circuitry is configured to determine that the current scene is related to the supplemental 3D AR figure by comparing metadata of the current scene to metadata of the supplemental 3D AR figure. 
     
     
       14. The system of  claim 12 , wherein the control circuitry is configured to determine that the current scene is related to the supplemental 3D AR figure by determining, based on a timestamp identifying the current scene, that the supplemental 3D AR figure is available at the timestamp. 
     
     
       15. The system of  claim 10 , wherein the control circuitry is configured to identify furniture within the viewing area by determining the shape and position of the furniture. 
     
     
       16. The system of  claim 10 , wherein the output circuitry is configured to provide for display the supplemental 3D AR figure in the first placement position by:
 in response to the device being at the first angle, providing for display the supplemental 3D AR figure in the first placement position; and 
 in response to the device being at the second angle, providing for display the supplemental 3D AR figure in the second placement position. 
 
     
     
       17. The system of  claim 10 , wherein the control circuitry is further configured to:
 determine there is no good placement position for the supplemental 3D AR content within the viewing area; and 
 in response to determining there is no good placement position, prompt the user to adjust the position of the furniture within the viewing area. 
 
     
     
       18. The system of  claim 17 , wherein:
 the output circuitry is further configured to provide for display an AR phantom outline of the furniture in a preferred position within the viewing area; and 
 the control circuitry is further configured to prompt the user to align the furniture within the viewing area to the AR phantom outline in the preferred position.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.