US10284816B2ActiveUtilityA1

Facilitating true three-dimensional virtual representation of real objects using dynamic three-dimensional shapes

34
Assignee: AZUMA RONALD TPriority: Mar 23, 2015Filed: Mar 23, 2015Granted: May 7, 2019
Est. expiryMar 23, 2035(~8.7 yrs left)· nominal 20-yr term from priority
Inventors:Ronald T. Azuma
G06T 15/005H04N 13/388G06T 15/10H04N 7/147G06T 19/20G06T 15/04G06T 17/20G02B 30/50H04N 7/157G02B 27/2271
34
PatentIndex Score
0
Cited by
16
References
22
Claims

Abstract

A mechanism is described for facilitating true three-dimensional (3D) virtual imaging on computing devices. A method of embodiments, as described herein, includes computing a virtual 3D model corresponding to an object. The method may further include computing and projecting, based the virtual 3D model, a unified surface image of the object via a dynamic 3D shape component, and generating and rendering a virtual image of the object based on the unified surface image such that the virtual image is capable of floating in air.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. An apparatus comprising:
 a processing device to facilitate: 
 computation and segmentation logic of a rendering engine to compute a virtual three-dimensional (3D) model of a real object captured by one or more devices and to segment the 3D model from a background of the real object captured by the one or more objects, using depth information of the real object, such that the 3D model is of the real object without the background of the real object; 
 dynamic 3D image computation and projection logic of the rendering engine to compute and project, based on the virtual 3D model of the real object, a unified surface image of the real object via a dynamic 3D shape component, wherein the dynamic 3D image computation and projection logic is configured to modify the shape of the dynamic 3D shape component based on the virtual 3D model of the real object; and 
 virtual image generation and rendering logic of the rendering engine to generate and render a virtual image of the real object based on the unified surface image from the dynamic 3D shape component, wherein the virtual generation and rendering logic is further to render the virtual image via an optical imaging plate and based on the unified surface image, wherein the unified surface image is reversed by the optical imaging plate. 
 
     
     
       2. The apparatus of  claim 1 , wherein the 3D model is a full scale virtual 3D model of the real object. 
     
     
       3. The apparatus of  claim 1 , wherein the real object comprises a 3D real object having a live object or a recorded object, wherein the live object is captured, in real-time, by detection and verification logic via one or more cameras coupled to the computing device, wherein the detection and verification logic is further to capture the high-resolution imagery of the live object. 
     
     
       4. The apparatus of  claim 3 , wherein the recorded object is obtained by reception logic, wherein the recorded object is obtained by directly accessing one or more computing devices having the recorded object or indirectly via one or more communication applications including one or more of an email application, a Short Message Service (SMS) application, and a collaboration application, wherein the reception logic is further to extract the high-resolution imagery from data associated with the recorded object. 
     
     
       5. The apparatus of  claim 1 , wherein the dynamic 3D image computation and projection logic is further to project, based on the virtual 3D model, multiple 3D-shaped images of the real object via the dynamic 3D shape component such that the multiple 3D-shaped images are projected as a single 3D image represented by the unified surface image, wherein each of the multiple 3D-shaped images is projected by a projector of a plurality of projectors. 
     
     
       6. The apparatus of  claim 1 , wherein the optical imaging plate comprises an Asukanet plate. 
     
     
       7. The apparatus of  claim 1 , wherein the dynamic 3D shape component further comprises a volumetric display. 
     
     
       8. The apparatus of  claim 1 , wherein the optical imaging plate and renders a floating 3D virtual image representing one or more of the depth, form, features, and characteristics of the real object. 
     
     
       9. A method comprising:
 computing, by a computing device, a virtual three-dimensional (3D) model of a real object captured by one or more devices; 
 segmenting the 3D model from a background of the real object captured by the one or more objects, using depth information of the real object, such that the 3D model is of the real object without the background of the real object; 
 computing and projecting, by the computing device, based on the virtual 3D model of the real object, a unified surface image of the real object via a dynamic 3D shape component, wherein the dynamic 3D image computation and projection logic is configured to modify the shape of the dynamic 3D shape component based on the virtual 3D model; and 
 generating and rendering, by the computing device, a virtual image of the real object based on the unified surface image, wherein the rendering of the virtual image is via an optical imaging plate and based on the unified surface image, wherein the unified surface image is reversed by the optical imaging plate. 
 
     
     
       10. The method of  claim 9 , wherein the 3D model is a full scale virtual 3D model of the real object. 
     
     
       11. The method of  claim 9 , wherein the real object comprises a 3D real object having a live object or a recorded object, wherein the live object and the high-resolution imagery are captured, in real-time, via one or more cameras coupled to the computing device. 
     
     
       12. The method of  claim 11 , wherein the recorded object is obtained by directly accessing one or more computing devices having the recorded object or indirectly via one or more communication applications including one or more of an email application, a Short Message Service (SMS) application, and a collaboration application, wherein the high-resolution imagery is extracted from data associated with the recorded object. 
     
     
       13. The method of  claim 9 , further comprising projecting, based on the virtual 3D model, multiple 3D-shaped images of the real object via the dynamic 3D shape component such that the multiple 3D-shaped images are projected as a single 3D image represented by the unified surface image, wherein each of the multiple 3D-shaped images is projected by a projector of a plurality of projectors. 
     
     
       14. The method of  claim 9 , wherein the optical imaging plate comprises an Asukanet plate. 
     
     
       15. The method of  claim 9 , wherein the dynamic 3D shape component comprises one or more of a deformable surface and a volumetric display. 
     
     
       16. At least one non-transitory machine-readable medium comprising a plurality of instructions, executed on a computing device, to facilitate the computing device to perform one or more operations comprising:
 computing a virtual three-dimensional (3D) model of aft a real object captured by one or more devices; 
 segmenting the 3D model from a background of the real object captured by the one or more objects, using depth information of the real object, such that the 3D model is of the real object without the background of the real object; 
 computing and projecting, based the virtual 3D model of the real object, a unified surface image of the real object via a dynamic 3D shape component, wherein the dynamic 3D image computation and projection logic is configured to modify the shape of the dynamic 3D shape component based on the virtual 3D model; and 
 generating and rendering a virtual image of the real object based on the unified surface image from the dynamic 3D shape component, wherein the virtual generation and rendering logic is further to render the virtual image via an optical imaging plate and based on the unified surface image, wherein the unified surface image is reversed by the optical imaging plate. 
 
     
     
       17. The non-transitory machine-readable medium of  claim 16 , wherein the 3D model is a full scale virtual 3D model of the real object. 
     
     
       18. The non-transitory machine-readable medium of  claim 16 , wherein the real object comprises a 3D real object having a live object or a recorded object, wherein the live object and the high-resolution imagery are captured, in real-time, via one or more cameras coupled to the computing device. 
     
     
       19. The non-transitory machine-readable medium of  claim 18 , wherein the recorded object is obtained by directly accessing one or more computing devices having the recorded object or indirectly via one or more communication applications including one or more of an email application, a Short Message Service (SMS) application, and a collaboration application, wherein the high-resolution imagery is extracted from data associated with the recorded object. 
     
     
       20. The non-transitory machine-readable medium of  claim 16 , further comprising projecting, based on the virtual 3D model, multiple 3D shaped images of the real object via the dynamic 3D shape component such that the multiple 3D-shaped images are projected as a single 3D image represented by the unified surface image, wherein each of the multiple 3D-shaped images is projected by a projector of a plurality of projectors. 
     
     
       21. The non-transitory machine-readable medium of  claim 16 , wherein the optical imaging plate comprises an Asukanet plate. 
     
     
       22. The non-transitory machine-readable medium of  claim 16 , wherein the dynamic 3D shape component comprises one or more of a deformable surface and a volumetric display.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.