Augmented devices

Abstract

Implementations use a first device (e.g., an HMD) to provide a CGR environment that augments the input and output capabilities of a second device, e.g., a laptop, smart speaker, etc. In some implementations, the first device communicates with a second device in its proximate physical environment to exchange input or output data. For example, an HMD may capture an image of a physical environment that includes a laptop. The HMD may detect the laptop, send a request the laptop's content, receive content from the laptop (e.g., the content that the laptop is currently displaying and additional content), identify the location of the laptop, and display a virtual object with the received content in the CGR environment on or near the laptop. The size, shape, orientation, or position of the virtual object (e.g., a virtual monitor or monitor extension) may also be configured to provide a better user experience.

What is claimed is: 
     
         1 . A method comprising:
 obtaining images of a physical environment;   identifying an electronic device in the physical environment, the electronic device comprising a display that displays a displayed object on a user interface on a two dimensional (2D) plane of the display; and   presenting a computer-generated reality (CGR) environment based on at least a portion of the images, wherein the CGR environment comprises a virtual object corresponding to the displayed object, wherein the virtual object is displayed with three-dimensional (3D) depth on a 3D interface at a location corresponding to the user interface on the 2D plane of the display in the CGR environment.   
     
     
         2 . The method of  claim 1 , wherein displaying the virtual object with 3D depth comprises displaying the virtual object to appear to extend out of the 2D plane. 
     
     
         3 . The method of  claim 1 , wherein the virtual object is a button and displaying the virtual object with 3D depth comprises displaying the button to appear to extend out of the 2D plane. 
     
     
         4 . The method of  claim 1 , wherein the virtual object is not limited to the 2D plane. 
     
     
         5 . The method of  claim 1 , wherein the user interface on the 2D plane of the display of the electronic device is configured for designing models of 3D objects and the virtual object comprises a 3D object being designed via the user interface. 
     
     
         6 . The method of  claim 1 , wherein the 3D object is provided in place of the user interface displayed on the 2D plane. 
     
     
         7 . A system comprising:
 a non-transitory computer-readable storage medium; and   one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:   obtaining images of a physical environment;   identifying an electronic device in the physical environment, the electronic device comprising a display that displays a displayed object on a user interface on a two dimensional (2D) plane of the display; and   presenting a computer-generated reality (CGR) environment based on at least a portion of the images, wherein the CGR environment comprises a virtual object corresponding to the displayed object, wherein the virtual object is displayed with three-dimensional (3D) depth on a 3D interface at a location corresponding to the user interface on the 2D plane of the display in the CGR environment.   
     
     
         8 . The system of  claim 7 , wherein displaying the virtual object with 3D depth comprises displaying the virtual object to appear to extend out of the 2D plane. 
     
     
         9 . The system of  claim 7 , wherein the virtual object is a button and displaying the virtual object with 3D depth comprises displaying the button to appear to extend out of the 2D plane. 
     
     
         10 . The system of  claim 7 , wherein the virtual object is not limited to the 2D plane. 
     
     
         11 . The system of  claim 7 , wherein the user interface on the 2D plane of the display of the electronic device is configured for designing models of 3D objects and the virtual object comprises a 3D object being designed via the user interface. 
     
     
         12 . The system of  claim 7 , wherein the 3D object is provided in place of the user interface displayed on the 2D plane. 
     
     
         13 . A non-transitory computer-readable storage medium, storing program instructions computer-executable on a computer to perform operations comprising:
 obtaining images of a physical environment;   identifying an electronic device in the physical environment, the electronic device comprising a display that displays a displayed object on a user interface on a two dimensional (2D) plane of the display; and   presenting a computer-generated reality (CGR) environment based on at least a portion of the images, wherein the CGR environment comprises a virtual object corresponding to the displayed object, wherein the virtual object is displayed with three-dimensional (3D) depth on a 3D interface at a location corresponding to the user interface on the 2D plane of the display in the CGR environment.   
     
     
         14 . The non-transitory computer-readable storage medium of  claim 13 , wherein displaying the virtual object with 3D depth comprises displaying the virtual object to appear to extend out of the 2D plane. 
     
     
         15 . The non-transitory computer-readable storage medium of  claim 13 , wherein the virtual object is a button and displaying the virtual object with 3D depth comprises displaying the button to appear to extend out of the 2D plane. 
     
     
         16 . The non-transitory computer-readable storage medium of  claim 13 , wherein the virtual object is not limited to the 2D plane. 
     
     
         17 . The non-transitory computer-readable storage medium of  claim 13 , wherein the user interface on the 2D plane of the display of the electronic device is configured for designing models of 3D objects and the virtual object comprises a 3D object being designed via the user interface. 
     
     
         18 . The non-transitory computer-readable storage medium of  claim 13 , wherein the 3D object is provided in place of the user interface displayed on the 2D plane.