Touch fee interface for augmented reality systems

Abstract

A method and system for augmented reality. Images of a real world scene are obtained from one or more from one or more image sensors. An orientation and/or location of the image sensors is obtained from one or more state sensors. A real world object at which a predefined pointing object is performing a predefined gesture in the images of the real world scene is identified and data associated with the identified object is displayed on a viewing device. The invention also provides a computer program comprising computer program code means for performing all the steps of the method of the invention when said program is run on a computer.

1 - 56 . (canceled) 
     
     
         57 . An augmented reality device, comprising:
 at least one processor configured to:
 receive, from an image sensor, image information associated with a real world scene; 
 detect, in the image information, a predefined hand gesture performed by the user; and 
 record at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection. 
   
     
     
         58 . The augmented reality device of  claim 57 , wherein the time is a predefined amount of time defined by the user. 
     
     
         59 . The augmented reality device of  claim 57 , wherein the at least one processor is further configured to cause a video or audio recording associated with the image information to be tagged based, at least in part, on the detection or detection of a second predefined hand gesture. 
     
     
         60 . The augmented reality device of  claim 59 , wherein the video or audio recording is a real-time video recording. 
     
     
         61 . The augmented reality device of  claim 57 , wherein the audio information includes sounds recorded by a microphone. 
     
     
         62 . The augmented reality device of  claim 57 , wherein the at least one processor is further configured to detect a second predefined hand gesture in the image information. 
     
     
         63 . The augmented reality device of  claim 62 , wherein the at least one processor is further configured to stop recording the at least one of video information or audio information in response to the detected second predefined hand gesture. 
     
     
         64 . The augmented reality device of  claim 62 , wherein the at least one processor is further configured to change a recording mode from a first mode to a second mode. 
     
     
         65 . The augmented reality device of  claim 62 , wherein the at least one processor is further configured to zoom in or out in response to the detected second predefined hand gesture. 
     
     
         66 . The augmented reality device of  claim 62 , wherein the at least one processor is further configured to capture a frame from the video information in response to the detected second predefined hand gesture. 
     
     
         67 . The augmented reality device of  claim 62 , wherein the at least processor is further configured to run a tracking algorithm that tracks an identified real world object in the image information, in response to the detected second predefined hand gesture. 
     
     
         68 . A method of operating an augmented reality device, the method performed by at least one processor and comprising:
 receiving, from an image sensor, image information associated with a real world scene;   detecting, in the image information, a predefined hand gesture performed by the user; and   recording at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection.   
     
     
         69 . The method of  claim 68 , wherein the time is a predefined amount of time defined by the user. 
     
     
         70 . The method of  claim 68 , further comprising causing a video or audio recording associated with the image information to be tagged based, at least in part, on the detection or detection of a second predefined hand gesture. 
     
     
         71 . The method of  claim 70 , wherein the video or audio recording is a real-time video recording. 
     
     
         72 . The method of  claim 68 , wherein the audio information includes sounds recorded by a microphone. 
     
     
         73 . The method of  claim 68 , wherein the at least one processor is further configured to change a recording mode from a first mode to a second mode. 
     
     
         74 . The method of  claim 73 , further comprising stopping recording the at least one of video information or audio information in response to the detected second predefined hand gesture. 
     
     
         75 . The method of  claim 73 , further comprising stopping recording the at least one of video information or audio information and change a recording mode a first mode to a second mode. 
     
     
         76 . The method of  claim 73 , further comprising capturing a frame from the video information in response to the detected second predefined hand gesture. 
     
     
         77 . The method of  claim 73 , further comprising running a tracking algorithm that tracks an identified real world object in the image information, in response to the detected second predefined hand gesture. 
     
     
         78 . A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method of operating an augmented reality device, the method comprising:
 receiving, from an image sensor, image information associated with a real world scene;   detecting, in the image information, a predefined hand gesture performed by the user; and   recording at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection.