Systems and methods for controlling device operation according to hand gestures

Abstract

Provided is a non-contact sensing device that comprises a sensor comprising a plurality of function key sensors. A function key sensor of the plurality of function key sensors has a field of view. The function key sensor is constructed and arranged to detect a hand gesture at the field of view and to generate a function key control signal in response to detecting the hand gesture at the field of view. A processor processes the function key control signal from the function key sensor and outputs a command to a remote apparatus in response to the processed control signal.

What is claimed is: 
     
         1 . A hand gesture control system, comprising:
 a control spot generator that forms a control spot at a surface;   a sensor that senses the presence of a hand in the control spot   at least one hand gesture sensor that provides a field of view for capturing images of a hand gesture at the control spot;   a processor that converts the captured images of the hand gesture into a command signal; and   a transmitter that outputs the command signal to an apparatus that translates the command signal to an action performed by the apparatus.   
     
     
         2 . The hand gesture control system of  claim 1 , wherein the sensor is at least one of a color sensor or a thermal sensor. 
     
     
         3 . The hand gesture control system of  claim 1 , further comprising a display for operating the apparatus, and a plurality of applications that are displayed from the display, which are activated in response to the command signal corresponding to the hand gesture. 
     
     
         4 . The hand gesture control system of  claim 1 , wherein the sensor comprises a visible-thermal dual band camera or multiple cameras for recognizing the hand gesture. 
     
     
         5 . The hand gesture control system of  claim 1 , wherein the processor converts the captured images of the hand gesture into a cursor command signal that controls a cursor at a display. 
     
     
         6 . The hand gesture control system of  claim 1 , wherein the processor converts the captured images of the hand gesture into a joystick command signal that controls the apparatus without interaction with the display. 
     
     
         7 . The hand gesture control system of  claim 1 , wherein the hand gesture control system is constructed and arranged for mounting to a ceiling, a mount, or a head band. 
     
     
         8 . The hand gesture control system of  claim 1 , the control spot is used as a reference beam for separating the hand gesture from a background using a parallax of the hand gesture that is larger than that of the background, which is further away from the cameras, wherein the control spot appears in two different distances before and after inserting a hand into the control spot. 
     
     
         9 . A method for providing non-contact switching and controlling an apparatus, comprising:
 sensing of hand signal in the field of view of a function key sensor of a imaging sensor lit up by color light of a control spot generator;   capturing a hand gesture images by one or multiple cameras in a control spot;   issuing, by a processor, a control command based on the assigned task of the function key sensor, the assigned task of the hand gesture, or both, sample of the image area to form an image pixel;   converting the image pixel to a function key pixel; and   controlling an apparatus by blocking a field of view of the function key pixel.   
     
     
         10 . A diffuser based control system comprising:
 a diffuser for smearing background details while keeping details for target near it,   a imaging sensor for capturing hand gestures   one or more function key sensors constructed from selected pixels of the imaging sensor   a light source for illuminating the target;   control spots for identifying field of views of function key sensors;   a processor for processing a combination of hand gesture images, function key sensor signals, and converting them into commands; and   a transceiver for sending commands to and receiving information from a control apparatus.