Touch fee interface for augmented reality systems

Abstract

A method and system for augmented reality. Images of a real world scene are obtained from one or more from one or more image sensors. An orientation and/or location of the image sensors is obtained from one or more state sensors. A real world object at which a predefined pointing object is performing a predefined gesture in the images of the real world scene is identified and data associated with the identified object is displayed on a viewing device. The invention also provides a computer program comprising computer program code means for performing all the steps of the method of the invention when said program is run on a computer.

1 .- 56 . (canceled) 
     
     
         57 . An augmented reality device, comprising:
 at least one processor configured to:
 receive, from an image sensor, image information associated with a real world scene; 
 detect, in the image information, a predefined hand gesture performed by the user; and 
 cause a video or audio recording to be tagged based, at least in part, on the detection. 
   
     
     
         58 . The augmented reality device of  claim 57 , wherein the video or audio recording is a real-time video recording. 
     
     
         59 . The augmented reality device of  claim 57 , wherein at least two tags are added to the video or audio recording. 
     
     
         60 . The augmented reality device of  claim 57 , wherein a frame of the video or audio recording is tagged. 
     
     
         61 . The augmented reality device of  claim 57 , wherein the at least one processor is further configured to record at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection or detection of a second predefined hand gesture. 
     
     
         62 . The augmented reality device of  claim 61 , wherein the time is a predefined amount of time defined by the user. 
     
     
         63 . The augmented reality device of  claim 57 , wherein the video or audio recording includes sounds recorded by a microphone. 
     
     
         64 . The augmented reality device of  claim 57 , wherein the at least one processor is further configured to capture a frame from the video information in response to the detected predefined hand gesture. 
     
     
         65 . The augmented reality device of  claim 57 , wherein the at least processor is further configured to run a tracking algorithm that tracks an identified real world object in the image information, in response to the detected second predefined hand gesture. 
     
     
         66 . A method of operating an augmented reality device, the method performed by at least one processor and comprising:
 receiving, from an image sensor, image information associated with a real world scene;   detecting, in the image information, a predefined hand gesture performed by the user; and   causing a video or audio recording to be tagged based, at least in part, on the detection.   
     
     
         67 . The method of  claim 66 , wherein the video or audio recording is a real-time video recording. 
     
     
         68 . The method of  claim 66 , wherein at least two tags are added to the video or audio recording. 
     
     
         69 . The method of  claim 66 , wherein a frame of the video or audio recording is tagged. 
     
     
         70 . The method of  claim 66 , further comprising recording at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection or detection of a second predefined hand gesture. 
     
     
         71 . The method of  claim 70 , wherein the time is a predefined amount of time defined by the user. 
     
     
         72 . The method of  claim 66 , wherein the video or audio recording includes sounds recorded by a microphone. 
     
     
         73 . The method of  claim 66 , further comprising detecting a second predefined hand gesture in the image information. 
     
     
         74 . The method of  73 , further comprising stopping recording the at least one of video information or audio information in response to the detected second predefined hand gesture. 
     
     
         75 . The method of  claim 73 , further comprising running a tracking algorithm that tracks an identified real world object in the image information, in response to the detected second predefined hand gesture. 
     
     
         76 . A non-transitory computer-readable medium storing instructions which, when executed, cause at least one processor to perform a method of operating an augmented reality device, the method comprising:
 receiving, from an image sensor, image information associated with a real world scene;   detecting, in the image information, a predefined hand gesture performed by the user; and   causing a video or audio recording to be tagged based, at least in part, on the detection.