System and method for communication using interactive avatar

Abstract

A video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar, initiating communication, capturing an image, detecting a face in the image, determining facial characteristics from the face, including eye movement and eyelid movement of a user indicative of direction of user gaze and blinking, respectively, converting the facial features to avatar parameters, and transmitting at least one of the avatar selection or avatar parameters.

1 - 22 . (canceled) 
     
     
         23 . A system for interactive avatar communication between a first user device and a remote user device, said system comprising:
 a camera configured to capture images;   a communication module configured to initiate and establish communication between said first and said remote user devices and to transmit and receive information between said first and said remote user devices; and   one or more storage mediums having stored thereon, individually or in combination, instructions that when executed by one or more processors result in the following operations comprising:
 selecting an avatar; 
 initiating communication; 
 capturing an image; 
 detecting a face in said image; 
 determining facial characteristics from said face, said facial characteristics comprising at least one of eye movement and eyelid movement; 
 converting said facial characteristics to avatar parameters; and 
 transmitting at least one of said avatar selection and avatar parameters. 
   
     
     
         24 . The system of  claim 23 , wherein determining facial characteristics from said face comprises determining a facial expression in said face. 
     
     
         25 . The system of  claim 23 , wherein determining facial characteristics from said face comprises determining at least one of gaze direction and blinking of said eyes based on statistical-based analysis selected from the group consisting of linear discriminant analysis (LDA), artificial neural network (ANN) and support vector machine (SVM). 
     
     
         26 . The system of  claim 23 , wherein said avatar selection and avatar parameters are used to generate an avatar on a remote device, said avatar being based on said facial characteristics. 
     
     
         27 . The system of  claim 23 , wherein said avatar selection and avatar parameters are used to generate an avatar in a virtual space, said avatar being based on said facial characteristics. 
     
     
         28 . The system of  claim 23 , wherein the instructions that when executed by one or more processors result in the following additional operations:
 receiving at least one of a remote avatar selection or remote avatar parameters.   
     
     
         29 . The system of  claim 28 , further comprising a display, wherein the instructions that when executed by one or more processors result in the following additional operations:
 displaying an avatar based on said remote avatar selection.   
     
     
         30 . The system of  claim 29 , wherein the instructions that when executed by one or more processors result in the following additional operations:
 animating said displayed avatar based on said remote avatar parameters.   
     
     
         31 . An apparatus for interactive avatar communication between a first user device and a remote user device, said apparatus comprising:
 a communication module configured to initiate and establish communication between said first and said remote user devices;   an avatar selection module configured to allow a user to select an avatar for use during said communication;   a face detection module configured to detect a facial region in an image of said user and to detect and identify one or more facial characteristics of said face, said facial characteristics comprising at least one of eye movement and eyelid movement of said user; and   an avatar control module configured to convert said facial characteristics to avatar parameters;   wherein said communication module is configured to transmit at least one of said avatar selection and avatar parameters.   
     
     
         32 . The apparatus of  claim 31 , further comprising an eye detection/tracking module configured to detect and identify at least one of eye movement of said user with respect to a display and eyelid movement of said user. 
     
     
         33 . The apparatus of  claim 32 , wherein said eye detection/tracking module comprises an eye classification module configured to determine at least one of gaze direction of said user's eyes user and blinking of said user's eyes. 
     
     
         34 . The apparatus of  claim 33 , wherein said determination of said gaze direction and blinking of said user's eyes by said eye detection/tracking module is based on statistical-based analysis selected from the group consisting of linear discriminant analysis (LDA), artificial neural network (ANN) and support vector machine (SVM). 
     
     
         35 . The apparatus of  claim 31 , wherein said avatar selection and avatar parameters are used to generate an avatar on said remote device, said avatar being based on said facial characteristics. 
     
     
         36 . The apparatus of  claim 31 , wherein said communication module is configured to receive at least one of a remote avatar selection or remote avatar parameters. 
     
     
         37 . The apparatus of  claim 36 , further comprising a display configured to display an avatar based on said remote avatar selection. 
     
     
         38 . The apparatus of  claim 37 , wherein said avatar control module is configured to animate said displayed avatar based on said remote avatar parameters. 
     
     
         39 . A method for interactive avatar communication, said method comprising:
 selecting an avatar;   initiating communication;   capturing an image;   detecting a face in said image;   determining facial characteristics from said face, said facial characteristics comprising at least one of eye movement and eyelid movement;   converting said facial characteristics to avatar parameters; and   transmitting at least one of said avatar selection or avatar parameters.   
     
     
         40 . The method of  claim 39 , wherein the avatar selection and avatar parameters are used to generate an avatar on a remote device, said avatar being based on said facial characteristics. 
     
     
         41 . The method of  claim 39 , further comprising receiving at least one of a remote avatar selection or remote avatar parameters. 
     
     
         42 . The method of  claim 41 , further comprising displaying an avatar based on the remote avatar selection. 
     
     
         43 . The method of  claim 42 , further comprising animating said displayed avatar based on said remote avatar parameters. 
     
     
         44 . At least one computer accessible medium storing instructions which, when executed by a machine, cause the machine to perform operations comprising:
 selecting an avatar;   initiating communication;   capturing an image;   detecting a face in said image;   determining facial characteristics from said face, said facial characteristics comprising at least one of eye movement and eyelid movement;   converting said facial characteristics to avatar parameters; and   transmitting at least one of said avatar selection or avatar parameters.