Gesture-based control and usage of video relay systems

Abstract

A system comprising a web-enabled video camera, at least one microphone, a remote server, and a command processing unit, which allow users to communicate remotely with video and audio. The system further is controlled by either gestures from a user, or a remote control, and can have gestures customized by the user for specific inputs. The system contains a menu the user may navigate, and multiple system states which provide different functionality and recognize different gesture commands.

What is claimed is: 
     
         1 . A system for gesture-based control and usage of video relay systems, comprising:
 a command processing unit comprising at least a processor, a memory, and a plurality of programming instructions stored in the memory and operating on the processor, wherein the programmable instructions, when operating on the processor, cause the processor to:
 receive a first video stream from a connected camera hardware device; 
 analyze at least a portion of the first video stream to identify a plurality of hand gestures; 
 correlate at least a portion of the identified hand gestures with a plurality of electronic commands; 
 transmit at least a portion of the first video stream via a network; 
 receive a second video stream via a network; and 
 direct the navigation of at least a software-based menu interface, the navigation being based at least in part on at least a portion of the electronic commands. 
   
     
     
         2 . The system of  claim 1 , wherein the command processing unit is further configured to navigate multiple system states based at least in part on at least a portion of the electronic commands. 
     
     
         3 . The system of  claim 1 , wherein the command processing unit is further configured to direct the operation of a phone dialer based at least in part on at least a portion of the electronic commands. 
     
     
         4 . The system of  claim 1 , wherein the electronic commands may be configured by a user and stored for future use. 
     
     
         5 . A method for gesture based control and usage of video relay systems, comprising the steps of:
 (a) receiving, at a command processing unit, a first video stream captured from a camera hardware device;   (b) analyzing at least a portion of the first video stream to identify a plurality of hand gestures;   (c) processing at least a portion of the hand gestures to produce a plurality of electronic commands;   (d) transmitting at least a portion of the first video stream via a network;   (e) directing the navigation of a software-based menu interface, the navigation being based at least in part on at least a portion of the electronic commands;   
     
     
         6 . The method of  claim 5 , further comprising the step of navigating multiple system states based at least in part on at least a portion of the electronic commands. 
     
     
         7 . The method of  claim 5 , wherein the command processing unit is further configured to direct the operation of a phone dialer based at least in part on at least a portion of the electronic commands. 
     
     
         8 . The method of  claim 5 , wherein the electronic commands may be configured by a user and stored for future use.