Generating augmented reality experiences utilizing physical objects to represent analogous virtual objects

Abstract

This disclosure describes embodiments of methods, non-transitory computer-readable media, and systems for detecting that a physical space includes a physical object corresponding to an analogous virtual object from an augmented reality experience and rendering (or otherwise modifying) the augment reality experience to integrate the physical object as part of the experience. In particular, the disclosed systems can determine that a physical object within a physical environment corresponds to an analogous virtual object of an augmented reality experience. Based on this correspondence, the disclosed systems can modify one or more of the virtual graphics, sound, or other features corresponding to the augmented reality experience to represent the virtual object using the physical object. For example, the disclosed systems can modify acoustic features of a sound for the augmented reality experience to simulate the sound originating from (or being affected by) the physical object.

1 . (canceled) 
     
     
         2 . A system comprising:
 one or more processors, operably coupled to at least one of the one or more processors;   a speaker, operably coupled to at least one of the one or more processors;   a display, operably coupled to at least one of the one or more processors;   a sensor, operably coupled to at least one of the one or more processors; and   one or more non-transitory memories, operably coupled to at least one of the one or more processors, comprising instructions that, when executed by at least one of the one or more processors, cause the system to:
 identify a physical object, based on data from the sensor, within a physical environment to represent a virtual object of an augmented reality experience; 
 simulate that a sound of the augmented reality experience originates from a location of the physical object or is affected by the physical object; 
 generate visual representation of at least a portion of the virtual object; and 
 present, utilizing the display and the speaker, the augmented reality experience with the simulated sound and the visual representation at the location of the physical object. 
   
     
     
         3 . The system as recited in  claim 2 , wherein:
 the sensor comprises a depth sensor; and   the instructions, when executed by at least one of the one or more processors, cause the system to identify the physical object based on depth sensor data from the depth sensor.   
     
     
         4 . The system as recited in  claim 2 , wherein:
 the sensor comprises a camera; and   the instructions, when executed by at least one of the one or more processors, cause the system to identify the physical object based on image data from the camera.   
     
     
         5 . The system as recited in  claim 2 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring an acoustic feature of the sound based on a physical characteristic of the physical object. 
     
     
         6 . The system as recited in  claim 5 , wherein the physical characteristic of the physical object comprises a size of the physical object, a direction that the physical object is pointed, a thickness of the physical object, a mass of the physical object, a shape of the physical object, or a density of the physical object. 
     
     
         7 . The system as recited in  claim 2 , wherein the instructions, when executed by at least one of the one or more processors, cause the system to:
 identify a visual characteristic of the virtual object, wherein the visual representation is generated based on the visual characteristic.   
     
     
         8 . The system as recited in  claim 2 , wherein the instructions, when executed by at least one of the one or more processors, cause the system to:
 detect a user interaction with the location of the physical object at which the visual representation is presented;   generate a new virtual graphic based on the user interaction with the location of the physical object; and   render the new virtual graphic within the physical environment.   
     
     
         9 . The system as recited in  claim 2 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring acoustic features of the sound to distort or muffle the sound based on a location of a virtual source of the sound relative to the location of the physical object. 
     
     
         10 . The system as recited in  claim 2 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring acoustic features of the sound to cause the sound to appear to a user as originating outside of the physical object rather than originating at the location of the physical object. 
     
     
         11 . The system as recited in  claim 2 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring acoustic features of the sound based on a location of a user relative to the location of the physical object. 
     
     
         12 . The system as recited in  claim 2 , wherein the augmented reality experience comprises a shared augmented reality experience between multiple users or a game experience. 
     
     
         13 . The system as recited in  claim 2 , wherein the instructions, when executed by at least one of the one or more processors, cause the system to:
 detect a user interaction with the location of the physical object at which the visual representation is presented; and   configure the simulated sound in response to the user interaction with the location of the physical object.   
     
     
         14 . A method comprising:
 identifying, based on data from a sensor, a physical object within a physical environment to represent a virtual object of an augmented reality experience;   simulating that a sound of the augmented reality experience originates from a location of the physical object or is affected by the physical object;   generating a visual representation of at least a portion of the virtual object; and   presenting, utilizing a display and a speaker, the augmented reality experience with the simulated sound and the visual representation at the location of the physical object.   
     
     
         15 . The method as recited in  claim 14 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring an acoustic feature of the sound based on a physical characteristic of the physical object. 
     
     
         16 . The method as recited in  claim 14 , further comprising:
 identifying a visual characteristic of the virtual object, wherein generating the visual representation is based on the visual characteristic.   
     
     
         17 . The method as recited in  claim 14 , further comprising:
 detecting a user interaction with the location of the physical object at which the visual representation is presented; and   configuring the simulated sound in response to the user interaction with the location of the physical object.   
     
     
         18 . A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause the at least one processor to:
 identify, based on data from a sensor, a physical object within a physical environment to represent a virtual object of an augmented reality experience;   simulate that a sound of the augmented reality experience originates from a location of the physical object or is affected by the physical object;   generate a visual representation of at least a portion of the virtual object; and   present, utilizing a display and a speaker, the augmented reality experience with the simulated sound and the visual representation at the location of the physical object.   
     
     
         19 . The non-transitory computer-readable medium as recited in  claim 18 , wherein the augmented reality experience comprises a shared augmented reality experience between multiple users. 
     
     
         20 . The non-transitory computer-readable medium as recited in  claim 18 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring acoustic features of the sound to distort or muffle the sound based on a location of a virtual source of the sound relative to the location of the physical object. 
     
     
         21 . The non-transitory computer-readable medium as recited in  claim 18 , wherein simulating that the sound of the augmented reality experience originates from the location of the physical object or is affected by the physical object comprises configuring acoustic features of the sound based on a location of a user relative to the location of the physical object.