US10755436B2ActiveUtilityA1

Placement of augmented reality objects using a bounding shape

68
Assignee: CAPITAL ONE SERVICES LLCPriority: Dec 21, 2017Filed: Nov 15, 2019Granted: Aug 25, 2020
Est. expiryDec 21, 2037(~11.5 yrs left)· nominal 20-yr term from priority
G06T 7/73G06T 11/00G06T 11/60G06T 19/006G06T 15/20G06T 2207/30204G06T 2210/12
68
PatentIndex Score
0
Cited by
32
References
20
Claims

Abstract

A system may include a camera, a display, one or more memories, and one or more processors communicatively coupled to the one or more memories. The system may output a bounding shape for presentation on the display. The bounding shape may be superimposed on an image being captured by the camera and presented on the display. The bounding shape may bound an object in the image. The system may determine 3D coordinates of an intersection point associated with the bounding shape. The intersection point may be a point where a projection of the bounding shape into 3D space intersects with a horizontal plane identified in the image. The system may determine 2D coordinates for presentation of an augmented reality object on the display based on the 3D coordinates of the intersection point, and may superimpose a representation of the augmented reality object on the image based on the 2D coordinates.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A method, comprising:
 determining, by a device, three-dimensional (3D) coordinates of an intersection point associated with a bounding shape,
 the bounding shape being superimposed on an image being captured by the device and rendered for display, and 
 the intersection point being a point where a projection of the bounding shape into 3D space intersects with a horizontal plane identified in the image; 
 
 determining, by the device, two-dimensional (2D) coordinates for presentation of an augmented reality object based on the determined 3D coordinates of the intersection point,
 wherein the 2D coordinates for presentation of the augmented reality object are generated by applying an offset to 2D coordinates that represent a position of a lower point of the bounding shape; and 
 
 superimposing, by the device, a representation of the augmented reality object on the image based on the determined 2D coordinates. 
 
     
     
       2. The method of  claim 1 , wherein the horizontal plane is identified as a ground plane. 
     
     
       3. The method of  claim 1 , wherein the intersection point is a point where a projection of a lower boundary, of the bounding shape, into 3D space intersects with the horizontal plane identified in the image. 
     
     
       4. The method of  claim 1 , wherein where the bounding shape is a bounding box. 
     
     
       5. The method of  claim 1 , wherein the offset represents at least one of:
 a distance between the augmented reality object and the horizontal plane, or 
 a height of a target object in the image. 
 
     
     
       6. The method of  claim 1 , wherein the 3D coordinates of the intersection point are determined based on an indication that the bounding shape is bounding a target object in the image. 
     
     
       7. The method of  claim 1 , wherein where the bounding shape is a circle or an oval. 
     
     
       8. A device, comprising:
 one or more memories; and 
 one or more processors communicatively coupled to the one or more memories, configured to:
 determine three-dimensional (3D) coordinates of an intersection point associated with a bounding shape,
 the bounding shape being superimposed on an image being captured by the device and rendered for display, 
 the intersection point being a point where a projection of the bounding shape into 3D space intersects with a horizontal plane identified in the image, and 
 a base of the bounding shape to be aligned with a base of a target object in the image; 
 
 determine two-dimensional (2D) coordinates for presentation of an augmented reality object based on the determined 3D coordinates of the intersection point,
 wherein the 2D coordinates for presentation of the augmented reality object are generated by applying an offset to 2D coordinates that represent a position of a lower point of the bounding shape; and 
 
 superimpose a representation of the augmented reality object on the image based on the determined 2D coordinates. 
 
 
     
     
       9. The device of  claim 8 , wherein the one or more processors are further to:
 automatically align the base of the bounding shape with the base of the target object; and 
 output an indication that the bounding shape is aligned with the target object. 
 
     
     
       10. The device of  claim 8 , wherein the one or more processors are further to:
 provide a user interface to allow a user to draw the bounding shape around the target object. 
 
     
     
       11. The device of  claim 8 , wherein where the bounding shape is a bounding box. 
     
     
       12. The device of  claim 8 , wherein the offset represents at least one of:
 a distance between the augmented reality object and the horizontal plane, or 
 a height of the target object in the image. 
 
     
     
       13. The device of  claim 8 , wherein the 3D coordinates of the intersection point are determined based on an indication that the bounding shape is bounding the target object in the image. 
     
     
       14. The device of  claim 8 , wherein where the bounding shape is a circle or an oval. 
     
     
       15. A non-transitory computer-readable medium storing instructions, the instructions comprising:
 one or more instructions that, when executed by one or more processors, cause the one or more processors to:
 determine three-dimensional (3D) coordinates of an intersection point associated with a bounding shape,
 the bounding shape being superimposed on an image being captured by a device and rendered for display; 
 
 determine two-dimensional (2D) coordinates for presentation of an augmented reality object based on the determined 3D coordinates of the intersection point,
 wherein the 2D coordinates for presentation of the augmented reality object are generated by applying an offset to 2D coordinates that represent a position of a lower point of the bounding shape; and 
 
 superimpose a representation of the augmented reality object on the image based on the determined 2D coordinates. 
 
 
     
     
       16. The non-transitory computer-readable medium of  claim 15 , wherein the intersection point is a point where a projection of the bounding shape into 3D space intersects with a horizontal plane identified in the image, and
 wherein the horizontal plane is identified as a ground plane. 
 
     
     
       17. The non-transitory computer-readable medium of  claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
 apply object recognition to change a size of the bounding shape to bound a target object in the image. 
 
     
     
       18. The non-transitory computer-readable medium of  claim 15 , wherein where the bounding shape is a bounding box. 
     
     
       19. The non-transitory computer-readable medium of  claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
 identify a plurality of target objects in the image; and 
 determine a priority level of the plurality of target objects in the image, 
 wherein the one or more instructions, that cause the one or more processors to superimpose the representation of the augmented reality object on the image, cause the one or more processors to:
 superimpose the bounding shape over a particular target object based on determining the priority level of the plurality of target objects. 
 
 
     
     
       20. The non-transitory computer-readable medium of  claim 15 , wherein where the bounding shape is a circle or an oval.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.