Touch Free Interface For Augmented Reality Systems

Abstract

A method and system for augmented reality. Images of a real world scene are obtained from one or more from one or more image sensors. An orientation and/or location of the image sensors is obtained from one or more state sensors. A real world object at which a predefined pointing object is performing a predefined gesture in the images of the real world scene is identified and data associated with the identified object is displayed on a viewing device. The invention also provides a computer program comprising computer program code means for performing all the steps of the method of the invention when said program is run on a computer.

1 .- 56 . (canceled) 
     
     
         57 . An immersive wearable display device having a plurality of operation modes, comprising:
 at least one processor configured to:   receive, from an image sensor, image information associated with a real world scene;   detect, in the image information, a predefined gesture performed by the user; and   change an operation mode of the image sensor from a first operation mode to a second operation mode associated with the detected predefined gesture.   
     
     
         58 . The device of  claim 57 , wherein the change in operation mode comprises a change in an operation mode of the image sensor. 
     
     
         59 . The device of  claim 58 , wherein the change in operation mode comprises a change in a capture rate of images captured by the image sensor. 
     
     
         60 . The device of  claim 58 , wherein the change in a resolution of images captured by the image sensor. 
     
     
         61 . The device of  claim 57 , wherein the change in operation mode comprises a change from a standby mode to an active mode. 
     
     
         62 . The device of  claim 61 , wherein the change from the standby mode to the active mode is associated a change in a number of video frames per second of the received image information being analyzed. 
     
     
         63 . A method for operating an immersive wearable display device having at least one viewing device configured to display a view of a scene to a user, the device having a plurality of operation modes, the method comprising:
 receiving, from an image sensor, image information associated with a real world scene;   detecting, by at least one processor, a predefined gesture performed by the user in the image information; and   changing, by the at least one processor, an operation mode of the image sensor from a first operation mode to a second operation mode associated with the detected predefined gesture.   
     
     
         64 . The method of  claim 63 , wherein the change in operation mode comprises a change in a number of frames per second of the received image information being analyzed. 
     
     
         65 . The method of  claim 63 , wherein the change in operation mode comprises a change in one or more gestures to be identified. 
     
     
         66 . The method of  claim 63 , wherein the change in operation mode comprises a change in one or more algorithms that are active in a gesture detection module. 
     
     
         67 . The method of  claim 63 , wherein the change in operation mode comprises a change from a standby mode to an active mode. 
     
     
         68 . The method of  claim 67 , wherein the change from the standby mode to the active mode is associated with a change in a number of video frames per second of the received image information being analyzed. 
     
     
         69 . The method of  claim 67 , wherein the change from the standby mode to the active mode is associated with an availability of visual data associated with the scene for output on the at least one viewing device of the wearable display device. 
     
     
         70 . An immersive wearable display system, comprising:
 at least one processor configured to:   receive, from an image sensor, image information associated with a real world scene;   detect, in the image information, a predefined gesture performed by the user;   correlate the predefined gesture with a first virtual visual object in the image information; and   provide a command to an external device based on the correlation, the external device being in communication with the wearable display device and configured to provide a to notification to the user in response to the command.   
     
     
         71 . The system of  claim 70 , wherein the first virtual visual object is an activatable icon, a virtual button, or a virtual key of a virtual keyboard. 
     
     
         72 . The system of  claim 70 , wherein, to correlate the predefined gesture with the visual data, the at least one processor is configured to:
 determine a reference location in three dimensional space of at least a portion of a hand of the user; and   determine data associated with the reference location.   
     
     
         73 . The system of  claim 70 , wherein the predefined gesture is a hand gesture. 
     
     
         74 . The system of  claim 70 , wherein the notification includes haptic feedback. 
     
     
         75 . The system of  claim 74 , wherein the haptic feedback comprises air tactile feedback. 
     
     
         76 . The system of  claim 70 , wherein the notification includes ultrasonic feedback.