Visualization of a knowledge domain

Abstract

An exemplary process obtains sensor data corresponding to a physical environment including one or more physical objects. A physical property of the one or more physical objects is determined based on the sensor data. A presentation mode associated with a knowledge domain is determined. An extended reality environment including a view of the physical environment and a visualization selected based on the determined presentation mode is provided. The visualization includes virtual content associated with the knowledge domain. The virtual content is provided based on display characteristics specified by the presentation mode that depend upon the physical property of the one or more objects.

What is claimed is: 
     
         1 . A method comprising:
 at an electronic device having a processor:
 obtaining sensor data corresponding to a physical environment comprising one or more physical objects; 
 determining a physical property of the one or more physical objects based on the sensor data; 
 determining a presentation mode associated with a knowledge domain; and 
 providing an extended reality (XR) environment comprising a view of the physical environment and a visualization selected based on the determined presentation mode, the visualization comprising virtual content associated with the knowledge domain, the virtual content provided based on display characteristics specified by the presentation mode that depend upon the physical property of the one or more objects. 
   
     
     
         2 . The method of  claim 1 , wherein determining the physical property of the one or more physical objects based on the sensor data comprises determining a scene understanding of the physical environment using computer-vision. 
     
     
         3 . The method of  claim 1 , wherein the knowledge domain corresponds to a scientific domain. 
     
     
         4 . The method of  claim 1 , wherein determining the presentation mode associated with the knowledge domain comprises receiving input selecting an educational experience. 
     
     
         5 . The method of  claim 1 , wherein determining the presentation mode associated with the knowledge domain comprises an automatic selection of the presentation mode based on a criterion. 
     
     
         6 . The method of  claim 1 , wherein the visualization comprises a visualization layer that is overlaid on the view of the physical environment. 
     
     
         7 . The method of  claim 1 , wherein the one or more physical objects comprise a first object and a second object, the first object comprising a first physical property and a second object comprising a second physical property that is different than the first physical property. 
     
     
         8 . The method of  claim 7 , wherein the virtual content comprises:
 a first virtual content portion that provides a first interaction with the first object based on a first display characteristic specified by the presentation mode based on the first object having the first physical property; and   a second virtual content portion that provides a second interaction with the second object based on a second display characteristic specified by the presentation mode based on the second object having the second physical property, wherein the first interaction and the second interaction are different types of interactions.   
     
     
         9 . The method of  claim 1 , further comprising:
 detecting an interaction with a physical object of the one or more physical objects; and   providing, based on the interaction, the presentation mode and a physical property of the physical object.   
     
     
         10 . The method of  claim 1 , wherein the knowledge domain is a first knowledge domain of a plurality of knowledge domains, and the presentation mode is associated with the plurality of knowledge domains. 
     
     
         11 . The method of  claim 10 , wherein the plurality of knowledge domains comprises a second knowledge domain that is different than the first knowledge domain, the method further comprising:
 modifying the visualization based on the second knowledge domain.   
     
     
         12 . The method of  claim 1 , wherein the physical property comprises at least one of a material composition, an object type, and an object classification. 
     
     
         13 . The method of  claim 1 , wherein the sensor data comprises depth data and light intensity image data obtained during an image capture process. 
     
     
         14 . The method of  claim 1 , wherein the electronic device is a head-mounted device (HMD). 
     
     
         15 . A device comprising:
 a non-transitory computer-readable storage medium; and   one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
 obtaining sensor data corresponding to a physical environment comprising one or more physical objects; 
 determining a physical property of the one or more physical objects based on the sensor data; 
 determining a presentation mode associated with a knowledge domain; and 
 providing an extended reality (XR) environment comprising a view of the physical environment and a visualization selected based on the determined presentation mode, the visualization comprising virtual content associated with the knowledge domain, the virtual content provided based on display characteristics specified by the presentation mode that depend upon the physical property of the one or more objects. 
   
     
     
         16 . The device of  claim 15 , wherein determining the physical property of the one or more physical objects based on the sensor data comprises determining a scene understanding of the physical environment using computer-vision. 
     
     
         17 . The device of  claim 15 , wherein the knowledge domain corresponds to a scientific domain. 
     
     
         18 . The device of  claim 15 , wherein determining the presentation mode associated with the knowledge domain comprises receiving input selecting an educational experience. 
     
     
         19 . The device of  claim 15 , wherein determining the presentation mode associated with the knowledge domain comprises an automatic selection of the presentation mode based on a criterion. 
     
     
         20 . A non-transitory computer-readable storage medium storing program instructions executable via one or more processors to perform operations comprising:
 obtaining sensor data corresponding to a physical environment comprising one or more physical objects;   determining a physical property of the one or more physical objects based on the sensor data;   determining a presentation mode associated with a knowledge domain; and   providing an extended reality (XR) environment comprising a view of the physical environment and a visualization selected based on the determined presentation mode, the visualization comprising virtual content associated with the knowledge domain, the virtual content provided based on display characteristics specified by the presentation mode that depend upon the physical property of the one or more objects.