Eye sign language communication system

Abstract

An Eye Sign language communication system and method is useful for people suffering from Quadriplegia, stroke or paralysis. The Eye Sign language communication system is based on advanced machine learning and deep learning to identify the eye sign language based on the eye blinks and direction of eye gaze with help of pupil for interpretation of signs into alphabets and words and conversion of words into speech. Hardware with sensors, controllers, and speakers along with a display screen are used to process the eye signs and display the alphabets, words and sentences and announce the detected alphabets, words and sounds using the speakers.

We claim: 
     
         1 . An Eye Sign language communication system ( 101 ), said system comprises of
 I/O module comprising of a touch display ( 102 ), a camera ( 103 ), a speaker ( 104 );   Language Module (LM) comprising of pre-defined eye movements and the corresponding alphabets and numbers provided to the User (U)   server ( 105 );   Power source ( 106 );   wherein said User (U) is positioned before the camera in a manner that face data is captured and landmark points in the face including eyes is detected;   Machine Learning and Deep Learning algorithms are used for identifying the Region of Interest (ROI);   the pre-defined eye movements of alphabets and numbers of said language module can be captured by said camera ( 103 );   on receiving CONFIRM signal from said User (U), said system provides voice output   on receiving RESUME and CONFIRM signal from said USER (U), said system starts a new iteration of capturing eye-movements and providing voice output   
     
     
         2 . The Eye Sign language communication system ( 101 ) as claimed in  claim 1 , wherein said system is an Interactive communication system. 
     
     
         3 . The Eye Sign language communication system ( 101 ) as claimed in  claim 1 , wherein said pre-defined eye-movements are the collection of pre-defined eye blinks and direction of eye gaze corresponding to pre-defined alphabets, numbers and words/phrases. 
     
     
         4 . The Eye Sign language communication system ( 101 ) as claimed in  claim 1 , wherein said pre-defined eye movements can be put together to form original sentence. 
     
     
         5 . A method for Eye Sign language communication system ( 101 ), said method comprising the steps of:
 preparing a language module comprising of pre-defined eye movements and the corresponding to alphabets and numbers;   deploying at least one camera ( 103   a ,  103   b ,  103   c  . . .  103   n ) in front of User (U);   Identifying the Region of Interest (ROI) including eyes movements of the User (U) by Machine Learning and Deep Learning   providing said User (U) with said language module comprising of pre-defined eye movements and the corresponding to alphabets and numbers;   Inputting “CONFIRM” by the User (U) through said predefined eye-movements to enable system to process the eye-movements and the corresponding alphabets and numbers to provide voice output;   Inputting “RESUME” signal followed by “CONFIRM” signal from said USER (U) to enable said system to start a new iteration of capturing eye-movements and providing voice output.