Method of Generating 3D Facial Model for an Avatar and Related Device

Abstract

A method of generating 3D facial geometry for an avatar, used in a computing device is disclosed. The method comprises obtaining a 2D image, performing a landmark detection operation on the 2D image, to obtain at least a facial feature with landmarks, determining weightings for a plurality of classifications of the facial feature based on relative distances of the landmarks, wherein the plurality of classifications are predefined in the computing device, and generating a 3D facial model based on a 3D face template with 3D parameters corresponding to the classifications of the facial feature and the weightings.

1 . A method of generating 3D facial geometry for an avatar, used in a computing device, the method comprising:
 obtaining a 2D image;   performing a landmark detection operation on the 2D image, to obtain a plurality of facial features with landmarks;   determining weightings for each of a plurality of classifications of the plurality of facial features based on relative distances of the landmarks, wherein the plurality of classifications of the plurality of facial features are predefined in the computing device; and   generating a 3D facial model based on a 3D face template with 3D parameters corresponding to the classifications of the plurality of facial features and the weightings.   
     
     
         2 . The method of  claim 1 , wherein the plurality of facial features comprise a face shape, eyes, eyebrows, a nose and a mouth. 
     
     
         3 . The method of  claim 2 , further comprising:
 determining at least a classification of the plurality of classifications of one of the plurality of facial features according to the relative distance of the landmarks.   
     
     
         4 . The method of  claim 3 , wherein determining the at least a classification of the plurality of classifications of the one of the plurality of facial features according to the relative distance of the landmarks comprises: determining a width and a length of the one of the plurality of facial features according to the relative distance of the landmarks, to obtain a ratio of the one of the plurality of facial features; and
 determining the classification of the one of the plurality of facial features according to the ratio.   
     
     
         5 . The method of  claim 1 , wherein determining the weightings for each of the plurality of classifications of the plurality of facial features based on the relative distances of the landmarks comprises:
 determining a width and a length of one of the plurality of facial features according to the relative distance of the landmarks, to obtain a ratio of the one of the plurality of facial features; and   determining the weightings for each of the plurality of classifications of the one of the plurality of facial features according to the ratio.   
     
     
         6 . An avatar simulation system comprising:
 a camera, for obtaining a 2D image;   a computing device or a cloud, for generating 3D facial model for an avatar;   wherein the computing device or the cloud includes:   a processing unit for executing a program; and   a storage unit coupled to the processing unit for storing the program; wherein the program instructs the processing unit to perform the following steps:
 obtaining a 2D image; 
 performing a landmark detection operation on the 2D image, to obtain a plurality of facial features with landmarks; 
 determining weightings for each of a plurality of classifications of the plurality of facial features based on relative distances of the landmarks, wherein the plurality of classifications of the plurality of facial features are predefined in the computing device; and 
 generating a 3D facial model based on a 3D face template with 3D parameters corresponding to the classifications of the plurality of facial features and the weightings. 
   
     
     
         7 . The avatar simulation system of  claim 6 , wherein the plurality of facial features comprise a face shape, eyes, eyebrows, a nose and a mouth. 
     
     
         8 . The avatar simulation system of  claim 7 , wherein the program further instructs the processing unit to perform the following steps:
 determining at least a classification of the plurality of classifications of one of the plurality of facial features according to the relative distance of the landmarks.   
     
     
         9 . The avatar simulation system of  claim 8 , wherein the program further instructs the processing unit to perform the following steps:
 determining a width and a length of the one of the plurality of facial features according to the relative distance of the landmarks, to obtain a ratio of the one of the plurality of facial features; and   determining the classification of the one of the plurality of facial features according to the ratio.   
     
     
         10 . The avatar simulation system of  claim 6 , wherein the program instructs the processing unit to perform the following steps:
 determining a width and a length of one of the plurality of facial features according to the relative distance of the landmarks, to obtain a ratio of the one of the plurality of facial features; and   determining the weightings for each of the plurality of classifications of the one of the plurality of facial features according to the ratio.   
     
     
         11 . A computing device for generating 3D facial geometry for an avatar, the computing device comprising:
 a processing unit for executing a program; and   a storage unit coupled to the processing unit for storing the program; wherein the program instructs the processing unit to perform the following steps:
 obtaining a 2D image; 
 performing a landmark detection operation on the 2D image, to obtain at least a plurality of facial features with landmarks; 
 determining weightings for each of a plurality of classifications of the plurality of facial features based on relative distances of the landmarks, wherein the plurality of classifications of the plurality of facial features are predefined in the computing device; and 
 generating a 3D facial model based on a 3D face template with 3D parameters corresponding to the classifications of the plurality of facial features and the weightings. 
   
     
     
         12 . The computing device of  claim 11 , wherein the plurality of facial features comprise a face shape, eyes, eyebrows, a nose and a mouth. 
     
     
         13 . The computing device of  claim 12 , wherein the program instructs the processing unit to perform the following steps:
 determining at least a classification of the plurality of classifications of one of the plurality of facial features according to the relative distance of the landmarks.   
     
     
         14 . The computing device of  claim 13 , wherein the program instructs the processing unit to perform the following steps:
 determining a width and a length of the one of the plurality of facial features according to the relative distance of the landmarks, to obtain a ratio of the one of the plurality of facial features; and   determining the classification of the one of the plurality of facial features according to the ratio.   
     
     
         15 . The computing device of  claim 11 , wherein the program instructs the processing unit to perform the following steps:
 determining a width and a length of one of the plurality of facial features according to the relative distance of the landmarks, to obtain a ratio of the one of the plurality of facial features; and   determining the weightings for each of the plurality of classifications of the one of the plurality of facial features according to the ratio.