Gesture-based casting and manipulation of virtual content in artificial-reality environments

Abstract

Embodiments are directed to a near eye display (NED) system for displaying artificial reality content to a user and to manipulate displayed content items based upon gestures performed by users of the NED system. A user of the NED system may perform a gesture simulating the throwing of an object to “cast” a content item to a target location in an artificial reality (AR) environment displayed by the NED system. The gesture may comprise a first portion in which the user's hand “grabs” or “pinches” a virtual object corresponding to the content item and moves backwards relative to their body, and a second portion in which the user's hand moves forwards relative to their body and releases the virtual object. The target location may be identified based upon a trajectory associated with the backwards motion of the first portion of the gesture.

What is claimed is: 
     
         1 . A system comprising:
 a near eye display (NED) comprising:
 an optical assembly having an electronic display that is configured to display images in accordance with display instructions; 
 an imaging device configured to capture one or more images of a portions of a local area of the NED; and 
   a controller configured to:
 determine that a first hand of a user of the NED located within the local area is performing a slice gesture, using the captured one or more images; 
 responsive to the slice gesture,
 display a first virtual menu at a position along a trajectory of the slice gesture, using the electronic display of the NED. 
 
   
     
     
         2 . The system of  claim 1 , wherein the trajectory is a linear path that extends in a particular direction. 
     
     
         3 . The system of  claim 2 , wherein the particular direction is a downward direction relative to a body of the user. 
     
     
         4 . The system of  claim 2 , wherein the linear path spans a distance of at least nine inches and the first hand moved through the linear path in at most a half a second. 
     
     
         5 . The system of  claim 1 , wherein the slice gestured corresponds to one or more fingers of the first hand remaining in a particular position as the first hand moves through the trajectory of the slice gesture. 
     
     
         6 . The system of  claim 5 , wherein the particular position corresponds to at least two fingers of the first hand being extended and held together. 
     
     
         7 . The system of  claim 6 , wherein the at least two fingers are an index and middle finger. 
     
     
         8 . The system of  claim 1 , wherein a centerline of the first virtual menu coincides with the trajectory of the slice gesture. 
     
     
         9 . A method comprising:
 capturing, via an imaging device, one or more images of a portions of a local area of a near eye display (NED);   determining that a first hand of a user of the NED located within the local area is performing a slice gesture, using the captured one or more images; and   responsive to the slice gesture, displaying using the electronic display of the NED a first virtual menu at a position along a trajectory of the slice gesture.   
     
     
         10 . The method of  claim 9 , wherein the trajectory is a linear path that extends in a particular direction. 
     
     
         11 . The method of  claim 10 , wherein the particular direction is a downward direction relative to a body of the user. 
     
     
         12 . The method of  claim 10 , wherein the linear path spans a distance of at least nine inches and the first hand moved through the linear path in at most a half a second. 
     
     
         13 . The method of  claim 9 , wherein the slice gestured corresponds to one or more fingers of the first hand remaining in a particular position as the first hand moves through the trajectory of the slice gesture. 
     
     
         14 . The method of  claim 13 , wherein the particular position corresponds to at least two fingers of the first hand being extended and held together. 
     
     
         15 . The method of  claim 14 , wherein the at least two fingers are an index and middle finger. 
     
     
         16 . The method of  claim 9 , wherein a centerline of the first virtual menu coincides with the trajectory of the slice gesture. 
     
     
         17 . A non-transitory computer readable medium storing instructions that, when executed by a processor of a near-eye display (NED), cause the NED to perform steps comprising:
 capturing, via an imaging device, one or more images of a portions of a local area of the NED;   determining that a first hand of a user of the NED located within the local area is performing a slice gesture, using the captured one or more images; and   responsive to the slice gesture, displaying using the electronic display of the NED a first virtual menu at a position along a trajectory of the slice gesture.   
     
     
         18 . The computer readable medium of  claim 17 , wherein the slice gestured corresponds to one or more fingers of the first hand remaining in a particular position as the first hand moves through the trajectory of the slice gesture. 
     
     
         19 . The computer readable medium of  claim 18 , wherein the particular position corresponds to at least two fingers of the first hand being extended and held together. 
     
     
         20 . The computer readable medium of  claim 17 , wherein a centerline of the first virtual menu coincides with the trajectory of the slice gesture.