Reactive augmented reality

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating composite images. One of the methods includes maintaining first data associating each location within an environment with a particular time; obtaining an image depicting the environment from a point of view of a display device; obtaining second data characterizing one or more virtual objects; and processing the obtained image and the second data to generate a composite image depicting the one or more virtual objects at respective locations in the environment from the point of view of the display device, wherein the composite image depicts each virtual object according to the particular time that the first data associates with the location of the virtual object in the environment.

What is claimed is: 
     
       1. A method comprising:
 obtaining position data representing a vector position of a display device; 
 obtaining first data depicting a plurality of views within a physical environment; 
 obtaining second data representing one or more transformations that can be integrated with the plurality of views; and 
 processing, for at least a first position, a second position, and a third position in a plurality of positions and using the position data, the first data and the second data to generate a composite image depicting one or more portions of the plurality of views within the physical environment with the one or more transformations from a perspective of a position represented by the position data, wherein for at least some of the one or more transformations, the transformation changes how the one or more portions of the plurality of views within the physical environment would appear at a particular point in time and wherein the first position is associated with a first time, a second position is associated with a second time, and a third position is associated with a third time, where the first, second, and third times are different. 
 
     
     
       2. The method of  claim 1 , wherein
 the particular point in time is a different date. 
 
     
     
       3. The method of  claim 1 , wherein
 the particular point in time is a different season. 
 
     
     
       4. The method of  claim 1 , comprising:
 obtaining third data characterizing one or more virtual objects; and 
 processing, for the virtual objects, the third data and the second data to generate the composite image depicting the virtual objects with the one or more transformations within the physical environment. 
 
     
     
       5. The method of  claim 4 , comprising:
 processing, using the position data and a second position data associated with the one or more virtual objects, the composite image depicting the one or more portions of the plurality of views within the physical environment with the one or more transformations from a perspective of the position represented by the position data and second position data, wherein a magnitude of the transformations is responsive to both i) an initial distance between the position data and the second position data and ii) a change in distance between the position data and the second position data. 
 
     
     
       6. The method of  claim 4  comprising:
 determining whether a distance between the position data and a second position data associated with the one or more virtual objects satisfies a threshold; and 
 in response to determining whether the distance between the position data and the second position data associated with the one or more virtual objects satisfies the threshold, triggering an action. 
 
     
     
       7. The method of  claim 6 , wherein the action is changing the transformation applied to the composite image or virtual object. 
     
     
       8. The method of  claim 6 , wherein the action is an animation applied within the composite image. 
     
     
       9. The method of  claim 6 , wherein the action is emitting a sound. 
     
     
       10. The method of  claim 1 , wherein the first data and the composite image are stereoscopic images. 
     
     
       11. The method of  claim 1  wherein processing, using the position data, the first data and the second data to generate the composite image depicting the one or more portions of the plurality of views within the physical environment with the one or more transformations comprises:
 determining a distance to a safety risk; and 
 providing for presentation on the display device a partial representation of the composite image, where the display device displays the safety risk without modification by the second data, based on the distance to the safety risk. 
 
     
     
       12. The method of  claim 1  wherein processing, using the position data, the first data and the second data to generate the composite image depicting the one or more portions of the plurality of views within the physical environment with the one or more transformations comprises:
 determining a distance to a safety risk; and 
 providing for presentation on the display device the composite image, where a transparency of the composite image changes proportionally with the distance to the safety risk. 
 
     
     
       13. The method of  claim 1  wherein processing, using the position data, the first data and the second data to generate the composite image depicting the one or more portions of the plurality of views within the physical environment with the one or more transformations comprises:
 progressively transforming the composite image in response to a change in the position data for the display device, wherein a magnitude of the transformation is proportional to the change in the position data in a specific direction. 
 
     
     
       14. The method of  claim 1 , wherein a magnitude of the transformations is responsive to an extent of change in the position data. 
     
     
       15. The method of  claim 1 , wherein the position within the physical environment is associated with a different transformation. 
     
     
       16. A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:
 obtaining position data representing a vector position of a display device; 
 obtaining first data depicting a plurality of views within a physical environment; 
 obtaining second data representing one or more transformations that can be integrated with the plurality of views; and 
 processing, for at least a first position, a second position, and a third position in a plurality of positions and using the position data, the first data and the second data to generate a composite image depicting one or more portions of the plurality of views within the physical environment with the one or more transformations from a perspective of a position represented by the position data, wherein for at least some of the one or more transformations, the transformation changes how the one or more portions of the plurality of views within the physical environment would appear at a particular point in time and wherein the first position is associated with a first time, a second position is associated with a second time, and a third position is associated with a third time, where the first, second, and third times are different. 
 
     
     
       17. The system of  claim 16 , wherein
 the particular point in time is a different date. 
 
     
     
       18. The system of  claim 16 , wherein;
 the particular point in time is a different season. 
 
     
     
       19. The system of  claim 16 , comprising:
 obtaining third data characterizing one or more virtual objects; and 
 processing, for the virtual objects, the third data and the second data to generate the composite image depicting the virtual objects with the one or more transformations within the physical environment. 
 
     
     
       20. One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one more computers to perform operations comprising:
 obtaining position data representing a vector position of a display device; 
 obtaining first data depicting a plurality of views within a physical environment; 
 obtaining second data representing one or more transformations that can be integrated with the plurality of views; and 
 processing, for at least a first position, a second position, and a third position in a plurality of positions and using the position data, the first data and the second data to generate a composite image depicting one or more portions of the plurality of views within the physical environment with the one or more transformations from a perspective of a position represented by the position data, wherein for at least some of the one or more transformations, the transformation changes how the one or more portions of the plurality of views within the physical environment would appear at a particular point in time and wherein the first position is associated with a first time, a second position is associated with a second time, and a third position is associated with a third time, where the first, second, and third times are different. 
 
     
     
       21. The non-transitory computer storage media of  claim 20 , comprising:
 obtaining third data characterizing one or more virtual objects; and 
 processing, for the virtual objects, the third data and the second data to generate the composite image depicting the virtual objects with the one or more transformations within the physical environment. 
 
     
     
       22. The non-transitory computer storage media of  claim 20 , wherein the first data and the composite image are stereoscopic images. 
     
     
       23. A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising a means for:
 obtaining position data representing a vector position of a display device; 
 obtaining first data depicting a plurality of views within a physical environment; 
 obtaining second data representing one or more transformations that can be integrated with the plurality of views; and 
 processing, for at least a first position, a second position, and a third position in a plurality of positions and using the position data, the first data and the second data to generate a composite image depicting one or more portions of the plurality of views within the physical environment with the one or more transformations from a perspective of a position represented by the position data, wherein for at least some of the one or more transformations, the transformation changes how the one or more portions of the plurality of views within the physical environment would appear at a particular point in time and wherein the first position is associated with a first time, a second position is associated with a second time, and a third position is associated with a third time, where the first, second, and third times are different.