Modes of control of virtual objects in 3d space

Abstract

Systems, methods, and non-transitory computer readable media for selectively controlling display of virtual objects are provided. Virtual objects may be virtually presented in an environment via a wearable extended reality appliance operable in a first and second display modes. In the first display mode, positions of the virtual objects are maintained in the environment regardless of detected movements of the wearable extended reality appliance, and in the second display mode, the virtual objects move in the environment in response to detected movements of the wearable extended reality appliance. Movement of the wearable extended reality appliance may be detected. A selection of the first or second display mode may be received. Display signals configured to present the virtual objects in a manner consistent with the selected display mode may be outputted for presentation via the wearable extended reality appliance in response to the selected display mode.

1 - 80 . (canceled) 
     
     
         81 . A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations steps for selectively controlling display of virtual objects, the steps comprising:
 virtually presenting a plurality of virtual objects in an environment via a wearable extended reality appliance operable in a first display mode and in a second display mode, wherein in the first display mode, positions of the plurality of virtual objects are maintained in the environment regardless of detected movements of the wearable extended reality appliance, and in the second display mode, the plurality of virtual objects move in the environment in response to detected movements of the wearable extended reality appliance;   detecting a movement of the wearable extended reality appliance;   receiving a selection of the first display mode or the second display mode for use in virtually presenting the plurality of virtual objects while the wearable extended reality appliance moves; and   in response to the selected display mode, outputting for presentation via the wearable extended reality appliance display signals configured to present the plurality of virtual objects in a manner consistent with the selected display mode.   
     
     
         82 . The non-transitory computer readable medium of  claim 81 , wherein the plurality of virtual objects presented via the wearable extended reality appliance are positioned on one or more virtual planes. 
     
     
         83 . The non-transitory computer readable medium of  claim 82 , wherein at least one of the one or more virtual planes is curved. 
     
     
         84 . The non-transitory computer readable medium of  claim 82 , wherein when the selected display mode is the first display mode, the steps further include detecting an input for repositioning at least one virtual object of the plurality of virtual objects on a different virtual plane. 
     
     
         85 . The non-transitory computer readable medium of  claim 84 , wherein the steps further include: upon repositioning the at least one virtual object, receiving an additional input indicative of a selection of the second display mode, and, after receiving the input indicative of the selection of the second display mode, in response to an additional detected movement of the wearable extended reality appliance, moving the one or more virtual planes and the different virtual plane in the environment consistent with the additional detected movement of the wearable extended reality appliance. 
     
     
         86 . The non-transitory computer readable medium of  claim 82 , wherein, when the selected display mode is the second display mode, the steps further include moving the one or more virtual planes consistent with the detected movement of the wearable extended reality appliance. 
     
     
         87 . The non-transitory computer readable medium of  claim 81 , wherein the plurality of virtual objects presented via the wearable extended reality appliance includes a first set of virtual objects presented on a substantially vertical surface and a second set of virtual objects presented on a substantially horizontal surface, and the steps further include determining a direction of the movement of the wearable extended reality appliance. 
     
     
         88 . The non-transitory computer readable medium of  claim 87 , wherein, when the selected display mode is the first display mode, and the steps further include rotating the first set of virtual objects while positions of the first set of virtual objects are maintained based on the determined direction of the movement of the wearable extended reality appliance and maintaining the second set of virtual objects in a non-rotated state. 
     
     
         89 . The non-transitory computer readable medium of  claim 87 , wherein, when the selected display mode is the second display mode, the steps further include moving the first set of virtual objects based on the detected movement of the wearable extended reality appliance while maintaining a position of the second set of virtual objects. 
     
     
         90 . The non-transitory computer readable medium of  claim 81 , wherein the plurality of virtual objects presented via the wearable extended reality appliance includes at least one virtual object docked to a physical object, and the steps further include determining a direction of the movement of the wearable extended reality appliance. 
     
     
         91 . The non-transitory computer readable medium of  claim 90 , wherein, when the selected display mode is the first display mode, the steps further include rotating virtual objects other than the at least one virtual object docked to the physical object while positions of the rotating virtual objects are maintained based on the determined direction of the movement of the wearable extended reality appliance. 
     
     
         92 . The non-transitory computer readable medium of  claim 90 , wherein, when the selected display mode is the second display mode, the steps further include moving the virtual objects other than the at least one virtual object docked to the physical object based on the detected movement of the wearable extended reality appliance. 
     
     
         93 . The non-transitory computer readable medium of  claim 81 , wherein the steps further include receiving input from a computing device connectable to the wearable extended reality appliance, and wherein the selection of the first display mode or the second display mode is based on the received input. 
     
     
         94 . The non-transitory computer readable medium of  claim 81 , wherein the steps further include receiving image data from an image sensor included in the wearable extended reality appliance, and wherein the selection of the first display mode or the second display mode is based on an analysis of the received image data. 
     
     
         95 . The non-transitory computer readable medium of  claim 81 , wherein the steps further include receiving audio data from a microphone included in the wearable extended reality appliance or in a computing device connectable to the wearable extended reality appliance, and wherein the selection of the first display mode or the second display mode is based on an analysis of the received audio data. 
     
     
         96 . The non-transitory computer readable medium of  claim 81 , wherein the steps further include determining a value of at least one parameter characterizing the movement of the wearable extended reality appliance, and wherein the selection of the first display mode or the second display mode is based on the determined value of the at least one parameter. 
     
     
         97 . The non-transitory computer readable medium of  claim 81 , wherein a particular virtual object of the plurality of virtual objects presents an output of a software application, and the steps further include, when the selected display mode is the first display mode:
 receiving an indication of an event associated with the software application; and   in response to the event, outputting for presentation via the wearable extended reality appliance second display signals configured to present at least the particular virtual object in a manner consistent with the second display mode.   
     
     
         98 . The non-transitory computer readable medium of  claim 81 , wherein the steps further include, when the selected display mode is the first display mode:
 receiving image data from an image sensor included in the wearable extended reality appliance;   analyzing the image data to identify a physical event; and   in response to the physical event, outputting for presentation via the wearable extended reality appliance second display signals configured to present at least one of the plurality of virtual objects in a manner consistent with the second display mode.   
     
     
         99 . A method for selectively controlling display of virtual objects, the method comprising:
 virtually presenting a plurality of virtual objects in an environment via a wearable extended reality appliance operable in a first display mode and in a second display mode, wherein in the first display mode, positions of the plurality of virtual objects are maintained in the environment regardless of detected movements of the wearable extended reality appliance, and in the second display mode, the plurality of virtual objects move in the environment in response to detected movements of the wearable extended reality appliance;   detecting a movement of the wearable extended reality appliance;   receiving a selection of the first display mode or the second display mode for use in presenting the plurality of virtual objects while the wearable extended reality appliance moves; and   in response to the display mode selection, outputting for presentation via the wearable extended reality appliance display signals configured to present the plurality of virtual objects in a manner consistent with the selected display mode.   
     
     
         100 . A system for selectively controlling display of virtual objects, the system comprising:
 at least one processor configured to:   virtually present a plurality of virtual objects in an environment via a wearable extended reality appliance operable in a first display mode and in a second display mode, wherein in the first display mode, positions of the plurality of virtual objects are maintained in the environment regardless of detected movements of the wearable extended reality appliance, and in the second display mode, the plurality of virtual objects move in the environment in response to detected movements of the wearable extended reality appliance;   detect a movement of the wearable extended reality appliance;   receive a selection of the first display mode or the second display mode for use in presenting the plurality of virtual objects while the wearable extended reality appliance moves; and   in response to the display mode selection, output for presentation via the wearable extended reality appliance display signals configured to present the plurality of virtual objects in a manner consistent with the selected display mode.   
     
     
         101 - 160 . (canceled)