P
US8624974B2ActiveUtilityPatentIndex 91

Generating a three-dimensional model using a portable electronic device recording

Assignee: APPLE INCPriority: Jan 28, 2009Filed: Sep 17, 2012Granted: Jan 7, 2014
Est. expiryJan 28, 2029(~2.6 yrs left)· nominal 20-yr term from priority
Inventors:TSAI RICHARDJUST ANDREWHARRIS BRANDON
H04N 21/42202H04N 21/422H04N 21/21805H04N 7/17318G06T 19/003G06T 17/05G06T 17/00G06T 15/20G06F 2200/1637G06F 2200/1614G06F 3/0346G06F 1/1626G06F 1/1613G01C 21/3602G01C 21/20
91
PatentIndex Score
11
Cited by
34
References
12
Claims

Abstract

Systems and methods are provided for navigating a three-dimensional model using deterministic movement of an electronic device. An electronic device can load and provide an initial display of a three dimensional model (e.g., of an environment or of an object). As the user moves the electronic device, motion sensing components can detect the device movement and adjust the displayed portion of the three-dimensional model to reflect the movement of the device. By walking with the device in the user's real environment, a user can virtually navigate a representation of a three-dimensional environment. In some embodiments, a user can record an object or environment using an electronic device, and tag the recorded images or video with movement information describing the movement of the device during the recording. The recorded information can then be processed with the movement information to generate a three-dimensional model of the recorded environment or object.

Claims

exact text as granted — not AI-modified
What is claimed 
     
       1. A method for displaying a three-dimensional model of an object, comprising:
 displaying a first image of a first portion of a three-dimensional model of an object using an electronic device, wherein the first image comprises a virtual view of the three-dimensional model of the object from the electronic device, the electronic device having a first virtual perspective and a first virtual location with respect to the three-dimensional model of the object; 
 detecting, with the electronic device, a first movement of the electronic device; 
 determining, based on the first movement, a second virtual perspective and second virtual location of the electronic device with respect to the three-dimensional model of the object, comprising:
 scaling a magnitude of the first movement, based in part on at least one of a direction of the first movement and a hysteresis or other non-linear correlation parameter; and 
 
 displaying, using the electronic device, a second image of a second portion of the three-dimensional model of the object based, at least in part, on the determined second virtual perspective and second virtual location. 
 
     
     
       2. The method of  claim 1 , wherein the act of detecting comprises:
 receiving, from a movement detection component of the electronic device, an output that indicates the first movement. 
 
     
     
       3. The method of  claim 1 , wherein the act of displaying further comprises:
 obtaining, from a source different from the electronic device, the second image. 
 
     
     
       4. The method of  claim 1 , wherein the first movement comprises a movement indicating a change in a zoom level of the three-dimensional model of the object from the first image to the second image. 
     
     
       5. The method of  claim 1 , wherein the act of determining further comprises:
 determining at least one of a velocity and an acceleration of the first movement. 
 
     
     
       6. An electronic device operative to display a three-dimensional model of an object, comprising:
 a display device operative to display a plurality of portions of an object; 
 a motion-sensing component operative to provide at least one output that reflects movement of the electronic device; and 
 one or more processors operative to:
 display a first image of a first portion of a three-dimensional model of the object, wherein the first image comprises a virtual view of the three-dimensional model of the object from the electronic device corresponding to a first virtual perspective and a first virtual location of the electronic device with respect to the three-dimensional model of the object; 
 receive output provided by the motion-sensing component, the received output corresponding to a first movement of the electronic device; 
 determine, based at least in part on the first movement, a second virtual perspective and second virtual location of the electronic device with respect to the three-dimensional model of the object, comprising:
 scaling a magnitude of the first movement, based in part on at least one of a direction of the first movement and a hysteresis or other non-linear correlation parameter; and 
 
 display a second image of a second portion of the three-dimensional model of the object corresponding, at least in part, to the second virtual perspective and the second virtual location with respect to the three-dimensional model of the object. 
 
 
     
     
       7. The electronic device of  claim 6 , wherein the one or more processors are further operative to generate the second image by:
 sending the received plurality of outputs to a host device for generating the second image; and 
 receiving the second image from the host device. 
 
     
     
       8. The electronic device of  claim 6 , wherein the one or more processors are further operative to:
 determine at least one of a velocity and an acceleration of the first movement. 
 
     
     
       9. A non-transitory computer readable medium for displaying a three-dimensional model, comprising computer readable code recorded thereon operative to:
 generate a first image of a first portion of a three-dimensional model of an object, wherein the first image comprises a virtual view of the three-dimensional model of the object from a first viewpoint, the first viewpoint having a first virtual perspective and a first virtual location with respect to the three-dimensional model of the object; 
 receive information indicative of a first movement of the first viewpoint; 
 determine, based on the first movement information, a second viewpoint having a second virtual perspective and second virtual location with respect to the three-dimensional model of the object, comprising:
 scaling a magnitude of the first movement, based in part on at least one of a direction of the first movement and a hysteresis or other non-linear correlation parameter; and 
 
 generate a second image of a second portion of the three-dimensional model of the object, wherein the second image comprises a virtual view of the three-dimensional model of the object from the second viewpoint. 
 
     
     
       10. The non-transitory computer readable medium of  claim 9 , further comprising computer readable code recorded thereon, operative to:
 transmit the information indicative of the first movement of the first viewpoint to a host device for generating the second image; and 
 receive the second image from the host device. 
 
     
     
       11. The non-transitory computer readable medium of  claim 9 , wherein the first movement comprises a movement indicating a change in a zoom level of the three-dimensional model of the object from the first image to the second image. 
     
     
       12. The non-transitory computer readable medium of  claim 9 , wherein the computer readable code operative to determined a second viewpoint comprises:
 computer readable code operative to determine at least one of a velocity and an acceleration of the first movement.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.