Mid-air ultrasonic haptic interface for immersive computing environments

Abstract

The present disclosure concerns an ultrasound system for providing tactile mid-air haptic feedback. As described herein, various embodiments of the invention can create a precise mid-air tactile sensation in mid-air on a body part of a user through use of an array of ultrasonic emitters. The array produces steerable focal points of ultrasonic energy that provide sufficient radiation pressure to be felt by the skin of the user. Such an implementation allows for multiple points of contact with immersive computing environments in a variety of form factors. This implementation, too, allows for coverage of larger distances and provides for a wider range of interactions thereby allowing a user to extend an appendage into a broader workspace while providing for multiple points of or comprehensive sensation or interaction without sacrificing user comfort with respect to any such interaction.

What is claimed is: 
     
         1 . A system for enabling a user to interact with an immersive environment, the system comprising:
 a processing system in communication with a tracking device, wherein the tracking device is configured to track a movement of the user, and wherein the processing system is configured to process the movement of the user;   an image projection device configured to project a set of images on a surface, the set of images comprising a set of virtual objects;   an ultrasonic stimulation device comprising a plurality of ultrasonic emitters configured to produce ultrasonic energy proximal to the surface, wherein the ultrasonic energy represents the set of virtual objects and is capable of perception by the user, and wherein the processing system is further configured to adjust the ultrasonic energy based on the movement of the user.   
     
     
         2 . The system of  claim 1 , wherein the processing system is further configured to adjust the ultrasonic energy based on the set of images. 
     
     
         3 . The system of  claim 1 , wherein the movement of the user comprises a movement of a hand of the user. 
     
     
         4 . The system of  claim 3 , wherein the movement of the hand of the user comprises a movement of each of a set of fingertips of the hand of the user. 
     
     
         5 . The system of  claim 1 , wherein the ultrasonic energy comprises mid-air ultrasonic stimulation. 
     
     
         6 . The system of  claim 5 , wherein the mid-air ultrasonic stimulation comprises a set of one or more localized focal points of ultrasonic energy produced through beamforming and constructive interference. 
     
     
         7 . A method for enabling a user to interact with an immersive environment, the method comprising:
 with a processing system, the processing system in communication with a tracking device:
 receiving location information from the tracking device; 
 processing the location information to determine a movement of the user; 
   with an image projection device in communication with the processing system:
 projecting a set of images on a surface, the set of images comprising a set of virtual objects; 
   with an ultrasonic stimulation device in communication with the processing system, the ultrasonic stimulation device comprising a plurality of ultrasonic emitters:
 producing ultrasonic energy proximal to the surface, wherein the ultrasonic energy represents the set of virtual objects and is capable of perception by the user; and 
   with the processing system:
 adjusting the ultrasonic energy based on the movement of the user. 
   
     
     
         8 . The method of  claim 7 , wherein the processing system is further configured to adjust the ultrasonic energy based on the set of images. 
     
     
         9 . The method of  claim 7 , wherein the movement of the user comprises a movement of a hand of the user. 
     
     
         10 . The method of  claim 9 , wherein the movement of the hand of the user comprises a movement of each of a set of fingertips of the hand of the user. 
     
     
         11 . The method of  claim 7 , wherein the ultrasonic energy comprises mid-air ultrasonic stimulation. 
     
     
         12 . A system for enabling a user to interact with an immersive environment, the system comprising:
 a processing system in communication with a tracking device, wherein the tracking device is configured to track a location of the user, and wherein the processing system is configured to process the location of the user;   a flexible ultrasonic stimulation device in communication with the processing system and configured to be arranged in both of a rolled-up configuration and an unrolled configuration, wherein the flexible ultrasonic stimulation device comprises:
 a plurality of ultrasonic emitters configured to produce ultrasonic energy in the unrolled configuration, the ultrasonic energy capable of perception by the user, wherein a set of commands used to produce the ultrasonic energy is determined based on the location of the user. 
   
     
     
         13 . The system of  claim 12 , wherein the flexible ultrasonic stimulation device comprises a panel composed of a flexible material. 
     
     
         14 . The system of  claim 13 , wherein the flexible material has material properties tuned to optimize an output of the plurality of ultrasonic emitters. 
     
     
         15 . The system of  claim 14 , wherein the plurality of ultrasonic emitters is integrated into the flexible material. 
     
     
         16 . The system of  claim 12 , further comprising an image projection device in communication with the processing system, the image projection device configured to project a set of images on a surface, the set of images comprising a set of virtual objects. 
     
     
         17 . The system of  claim 12 , wherein the location of the user comprises a location of a hand of the user. 
     
     
         18 . The system of  claim 17 , wherein the location of the hand of the user comprises a location of each of a set of fingertips of the hand of the user. 
     
     
         19 . The system of  claim 12 , wherein the ultrasonic energy comprises mid-air ultrasonic stimulation. 
     
     
         20 . The system of  claim 19 , wherein the mid-air ultrasonic stimulation comprises a set of one or more localized focal points of ultrasonic energy produced through beamforming and constructive interference.