System and Methods of Camera-Based Fingertip Tracking

Abstract

Systems and methods for camera-based fingertip tracking are disclosed. One such method includes identifying at least one location of a fingertip in at least one of the video frames, and mapping the location to a user input based on the location of the fingertip relative to a virtual user input device.

What is claimed is: 
     
         1 . A method of translating sign language, the method comprising receiving a series of images from a camera pertaining to a motion of a provider's hand, finger, fingertip, and/or arm corresponding to a first unit of sign language information;
 processing the images to correlate the motion to a stored unit of information stored on a computer readable medium; and   outputting an output unit of information to a receiver in a form different relative to the first unit of information.   
     
     
         2 . The method of  claim 1 , wherein said outputting comprises providing an aural signal. 
     
     
         3 . The method of  claim 2 , wherein said aural signal comprises speaking a word to which the first unit of information pertains. 
     
     
         4 . The method of  claim 1 , wherein said outputting comprises providing a word in text form. 
     
     
         5 . The method of  claim 1 , wherein said outputting comprises providing a word in tactile form. 
     
     
         6 . The method of  claim 5 , wherein said tactile form is Braille. 
     
     
         7 . The method of  claim 1 , wherein said outputting comprises providing image information comprising motion of a hand, finger, fingertip, and/or arm pertaining to sign language of type different than said first unit of information. 
     
     
         8 . The method of  claim 7 , wherein said different type of sign language is of a language different than that of said first unit of information. 
     
     
         9 . The method of  claim 1 , wherein said outputting comprises displaying an visual image of an object to which the first unit of sign language information pertains. 
     
     
         10 . A system for manipulating a virtual object, the system comprising an eyewear device comprising a lens that generates an image field that displays a virtual object; a camera that monitor's motion in said image field, and a computer programmed to track motion of a user in the image field and mapping the motion to said virtual object. 
     
     
         11 . The system of  claim 10 , wherein said eyewear device comprises eyeglasses, and where said camera is affixed to said eyeglasses. 
     
     
         12 . The system of  claim 10 , wherein said eyewear device is a contact lens. 
     
     
         13 . A system for translating sign language, the system comprising a camera in communication with a computer, the computer comprising a computer readable media and being programmed to receive video image of a unit of sign language motion, correlating the sign language motion to unit of information stored on the computer readable media; and an output device for outputting an output unit of information, wherein the computer is programmed to output the output unit of information via said output device. 
     
     
         14 . The system of  claim 13 , wherein said output device comprises a speaker, display, or Braille machine.