Touch fee interface for augmented reality systems

Abstract

A method and system for augmented reality. Images of a real world scene are obtained from one or more from one or more image sensors. An orientation and/or location of the image sensors is obtained from one or more slate sensors. A real world object at which a predefined pointing object is performing a predefined gesture in the images of the real world scene is identified and data associated with the identified object is displayed on a viewing device. The invention also provides a computer program comprising computer program code means for performing all the steps of the method of the invention when said program is run on a computer.

1 .- 56 . (canceled) 
     
     
         57 . An augmented reality device having a plurality of operation modes, comprising:
 at least one processor configured to:
 receive, from an image sensor, image information associated with a real world scene; 
 output, to a display, visual data associated with the received image information to enable a user to view the visual data, and view at least a portion of the real world scene in a see-through area of the display; 
 detect, in the image information, a predefined gesture performed by the user; and 
 change an operation mode of the augmented reality device from a first operation mode to a second operation mode associated with the detected predefined gesture. 
   
     
     
         58 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises selecting a source of visual material to be presented. 
     
     
         59 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises selecting a level of detail of visual material to be presented. 
     
     
         60 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises selecting one or more buttons or activatable icons to be presented on the display. 
     
     
         61 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises activating an online service. 
     
     
         62 . The augmented reality device of  claim 61 , wherein the online service is related to a selected real world object. 
     
     
         63 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises a change in a number of frames per second of the received image information being analyzed. 
     
     
         64 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises a change in one or more gestures to be identified. 
     
     
         65 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises a change in one or more algorithms that are active in a gesture detection module. 
     
     
         66 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises a change in an operation mode of the image sensor. 
     
     
         67 . The augmented reality device of  claim 66 , wherein the change in operation mode comprises a change in a capture rate of images captured by the image sensor. 
     
     
         68 . The augmented reality device of  claim 66 , wherein the change in a resolution of images captured by the image sensor. 
     
     
         69 . The augmented reality device of  claim 57 , wherein the change in operation mode comprises a change from a standby mode to an active mode. 
     
     
         70 . The augmented reality device of  claim 69 , wherein the change from the standby mode to the active mode is associated a change in a number of video frames per second of the received image information being analyzed. 
     
     
         71 . The augmented reality device of  claim 69 , wherein the change from the standby mode to the active mode is associated with an availability of visual data associated with the real world scene for output on a display of the augmented reality device. 
     
     
         72 . A method for operating an augmented reality device having a plurality of operation modes, comprising:
 receiving, by at least one processor from an image sensor, image information associated with a real world scene;   outputting, to a display, visual data associated with the received image information to enable a user to view the visual data, and view at least a portion of the real world scene in a see-through area of the display;   detecting, by the at least one processor in the image information, a predefined gesture performed by the user; and   changing, by the at least one processor, an operation mode of the augmented reality device from a first operation mode to a second operation mode associated with the detected predefined gesture.   
     
     
         73 . The method of  claim 72 , wherein the change in operation mode comprises a change in a number of frames per second of the received image information being analyzed. 
     
     
         74 . The method of  claim 72 , wherein the change in operation mode comprises a change in one or more gestures to be identified. 
     
     
         75 . The method of  claim 72 , wherein the change in operation mode comprises a change in one or more algorithms that are active in a gesture detection module. 
     
     
         76 . The method of  claim 72 , wherein the change in operation mode comprises a change in an operation mode of the image sensor. 
     
     
         77 . The method of  claim 76 , wherein the change in operation mode comprises a change in a capture rate of images captured by the image sensor. 
     
     
         78 . The method of  claim 76 , wherein the change in operation mode comprises a change in a resolution of images captured by the image sensor. 
     
     
         79 . The method of  claim 72 , wherein the change in operation mode comprises a change from a standby mode to an active mode. 
     
     
         80 . The method of  claim 79 , wherein the change from the standby mode to the active mode is associated with a change in a number of video frames per second of the received image information being analyzed. 
     
     
         81 . The method of  claim 79 , wherein the change from the standby mode to the active mode is associated with an availability of visual data associated with the real world scene for output on a display of the augmented reality device. 
     
     
         82 . A non-transitory computer readable medium having stored thereon instructions which, when executed, cause one or more processors to perform a method for operating an augmented reality device having a plurality of operation modes, the method comprising:
 receiving image information associated with a real world scene;   outputting, to a display, visual data associated with the received image information to enable a user to view the visual data, and view at least a portion of the real world scene in a see-through area of the display;   detecting, by the at least one processor in the image information, a predefined gesture performed by the user; and   changing, by the at least one processor, an operation mode of the augmented reality device from a first operation mode to a second operation mode associated with the detected predefined gesture.