Expression recognition in messaging systems

Abstract

Some embodiments include a messaging system capable of expression-based communication and/or expression-based actions. The messaging system can run on a computing device. For example, the messaging system monitors a camera feed from a camera of the computing device to detect a biometric signature when a messaging interface of the messaging application is actively being used. The messaging system can match the detected biometric signature against a known profile utilizing a facial recognition process to authenticate an operating user to use the messaging application. The messaging system can determine a human expression based on the detected biometric signature utilizing an expression recognition process to associate a contextual tag with an activity on the messaging interface. The messaging system can then communicate with a message server system to associate the contextual tag with content presented to the operating user or a conversation participated by the operating user via the messaging application.

What is claimed is: 
     
         1 . A computer device comprising at least one processor in communication with at least one memory device, wherein the at least one processor is programmed to:
 monitor a sensor feed provided by one or more sensors of the computer device to detect a biometric signature;   detect a facial profile based on the biometric signature and match the facial profile against a known facial profile utilizing a facial recognition process to identify an operating user;   determine a human expression based on the detected biometric signature utilizing an expression recognition process to associate a contextual tag; and   store, in the at least one memory device, the contextual tag.   
     
     
         2 . The computer device of  claim 1 , wherein the at least one processor is further programmed to transmit the contextual tag to an external server. 
     
     
         3 . The computer device of  claim 1 , wherein the at least one processor is further programmed to:
 receive a targeted advertisement creative; and   present the targeted advertisement creative based on the contextual tag and an identity of the operating user.   
     
     
         4 . The computer device of  claim 3 , wherein the at least one processor is further programmed to receive an expression trigger condition associated with the targeted advertisement creative from at least one of a message server system or an advertisement service server, wherein the targeted advertisement creative is presented in response to determining that the contextual tag corresponds to the expression trigger condition. 
     
     
         5 . The computer device of  claim 4 , wherein the expression trigger condition includes a smile, a laugh, a grimace, a frown, a pout, or any combination thereof. 
     
     
         6 . The computer device of  claim 4 , wherein the expression trigger condition includes an expression corresponding to a mood or an emotion, a micro expression, a stimulated expression, a neutralized expression, a masked expression, or any combination thereof. 
     
     
         7 . The computer device of  claim 4 , wherein the at least one processor is further programmed to select the targeted advertisement creative for display from a plurality of options based on the contextual tag. 
     
     
         8 . The computer device of  claim 7 , wherein the at least one processor is further programmed to select the targeted advertisement creative further is based on a time stamp of the contextual tag in relation to an activity occurring at the time stamp. 
     
     
         9 . The computer device of  claim 7 , wherein the at least one processor is further programmed to select the targeted advertisement creative based on an expression trigger condition associated with the targeted advertisement creative. 
     
     
         10 . The computer device of  claim 1 , wherein the at least one processor is further programmed to:
 determine a current activity for the computing device; and   update a profile of the operating user based on the current activity and the contextual tag.   
     
     
         11 . The computer device of  claim 10 , wherein the current activity includes operating a messaging application. 
     
     
         12 . The computer device of  claim 1 , wherein a human facial expression is captured in real-time from the one or more sensors. 
     
     
         13 . A computer-implemented method of operating a computing device, the method comprising:
 monitoring a sensor feed provided by one or more sensors of the computer device to detect a biometric signature;   detecting a facial profile based on the biometric signature and match the facial profile against a known facial profile utilizing a facial recognition process to identify an operating user;   determining a human expression based on the detected biometric signature utilizing an expression recognition process to associate a contextual tag; and   storing, in a memory device, the contextual tag.   
     
     
         14 . The method of  claim 13  further comprising:
 receiving a targeted advertisement creative; and 
 presenting the targeted advertisement creative based on the contextual tag and an identity of the operating user. 
 
     
     
         15 . The method of  claim 13  further comprising receiving an expression trigger condition associated with the targeted advertisement creative from at least one of a message server system or an advertisement service server, wherein the targeted advertisement creative is presented in response to determining that the contextual tag corresponds to the expression trigger condition. 
     
     
         16 . The method of  claim 15 , wherein the expression trigger condition includes a smile, a laugh, a grimace, a frown, a pout, or any combination thereof. 
     
     
         17 . The method of  claim 15 , wherein the expression trigger condition includes an expression corresponding to a mood or an emotion, a micro expression, a stimulated expression, a neutralized expression, a masked expression, or any combination thereof. 
     
     
         18 . The method of  claim 14  further comprising selecting the targeted advertisement creative for display from a plurality of options based on the contextual tag. 
     
     
         19 . The method of  claim 18  further comprising selecting the targeted advertisement creative further is based on a time stamp of the contextual tag in relation to an activity occurring at the time stamp. 
     
     
         20 . A computer device comprising at least one processor in communication with at least one memory device, wherein the at least one processor is programmed to:
 monitor a sensor feed provided by one or more sensors of the computer device to detect a biometric signature;   detect a facial profile based on the biometric signature and match the facial profile against a known facial profile utilizing a facial recognition process to identify an operating user;   determine a human expression based on the detected biometric signature utilizing an expression recognition process to associate a contextual tag;   determine a current activity for the computing device;   associate the current activity for the computing device with the contextual tag and the human expression; and   update a profile of operating user preferences for digital content based on the association.   
     
     
         21 . The computer device of  claim 20 , wherein the at least one processor is further programmed to:
 detect a plurality of human expressions associated with the known facial profile over a period of time;   determine a human expression for each of the detected human expression;   associated a contextual tag with each of the plurality of human expressions; and   generate the profile of operating user preferences for digital content based on the plurality of human expressions and the plurality of contextual tags.   
     
     
         22 . The computer device of  claim 20 , wherein the at least one processor is further programmed to determine a targeted advertisement creative to display to the operating user based on the profile of operating user preferences for digital content. 
     
     
         23 . The computer device of  claim 20 , wherein the at least one processor is further programmed to determine one or more pieces of digital content to display to the operating user based on the profile of operating user preferences for digital content. 
     
     
         24 . The computer device of  claim 23 , wherein the digital content includes one or more of emoticons, text, photos, audio clips, videos, links, images, or any combination thereof. 
     
     
         25 . The computer device of  claim 24 , wherein each piece of digital contents is associated with an expression trigger condition, and wherein the at least one processor is further programmed to:
 determine a current contextual tag based on a current human expression; and   compare the current contextual tag with the plurality of expression trigger conditions to determine a piece of digital content to display to the operating user.   
     
     
         26 . The computer device of  claim 20 , wherein the at least one processor is further programmed to:
 aggregate a timestamp of the current activity with the detected biometric signal and the associated contextual tag;   determine one or more timing preferences for the operating user; and   update the profile of operating user preferences for digital content based on the one or more timing preferences.