Systems and methods for sensor data analysis through machine learning

Abstract

Sensor data analysis may include obtaining video data, detecting facial data within the video data, extracting the facial data from the video data, detecting indicator data within the video data, extracting the indicator data from the video data, transforming the extracted facial data into representative facial data, and determining a mood of the person by associating learned mood indicators derived from other detected facial data with the representative facial data. The analysis may include determining that the representative facial data is associated with a complex profile, and determining a context regarding the person within the environment by weighting and processing the determined mood, at least one subset of data representing information about the person of the complex profile, and the indicator data. The analysis may include determining a user experience for the person, and communicating the determined user experience to a device associated with the person.

1 .- 20 . (canceled) 
     
     
         21 . A system for processing real-time sensor data, comprising:
 a memory device that stores a set of instructions; and   a processor that executes the instructions to:
 receive real-time data from one or more sensors; 
 determine a capability of a system to process the real-time data, the capability comprising a storage capacity or processing power of the system; 
 determine a processing speed associated with a desired processing of the real-time data; 
 select a processing model in response to the determined capability and the processing speed; and 
 process the real-time data using the selected processing model to apply a device experience associated with an actor to a device associated with the actor. 
   
     
     
         22 . The system of  claim 21 , wherein the processor is further configured to execute the instructions to:
 determine whether the received real-time data is associated with one or more existing complex profiles, the one or more existing complex profiles including at least one subset of data representing information associated with the actor; and   in response to a determination that the received real-time data is not associated with any existing complex profiles, generate one or more new complex profiles.   
     
     
         23 . The system of  claim 22 , wherein the at least one processor is further configured to execute the instructions to generate the one or more new complex profiles by:
 analyzing the received real-time data from the one or more sensors;   searching for a target actor present in the received real-time data;   collecting data associated with the target actor; and   generating a corresponding complex profile for the target actor based on the collected data.   
     
     
         24 . The system of  claim 22 , wherein the at least one processor is further configured to execute the instructions to:
 in response to a determination that the received real-time data is associated with a corresponding existing complex profile, update the corresponding existing complex profile with information contained in the received real-time data.   
     
     
         25 . The system of  claim 22 , wherein the at least one subset of data representing information about the actor includes data associated with one or more of social profile information, location information, identification information, age information, interest information, or linked account information of the actor. 
     
     
         26 . The system of  claim 21 , wherein the system comprises two or more processing models, and the two or more processing models differ in how one or more characteristics of the real-time data are weighted, how one or more types of the real-time data are processed, or both. 
     
     
         27 . The system of  claim 21 , wherein the at least one processor is further configured to receive the real-time data from the one or more sensors by:
 obtaining audio data from at least one microphone in an environment; and   detecting voice data within the audio data, the voice data being associated with the actor in the environment.   
     
     
         28 . The system of  claim 21 , wherein the at least one processor is further configured to receive the real-time data from the one or more sensors by:
 obtaining video data from at least one camera in an environment; and   detecting facial data within the video data, wherein the facial data is associated with the actor in the environment.   
     
     
         29 . The system of  claim 21 , further comprising:
 one or more databases configured to store one or more of the received real-time data, complex profile data, and the processing model.   
     
     
         30 . The system of  claim 21 , wherein the at least one processor is further configured to select a processing model in response to a type of data corresponding to the received real-time data, a user input, a desired level of anonymity, lossiness of the real-time data, a desired level of confidence of identifying the actor from the real-time data, or any combination thereof. 
     
     
         31 . A method for processing real-time sensor data, comprising:
 receiving real-time data from one or more sensors;   determining a capability of a system to process the real-time data, the capability comprising a storage capacity or processing power of the system;   determining a processing speed associated with a desired processing of the real-time data;   selecting a processing model in response to the determined capability and the processing speed; and   processing the real-time data using the selected processing model to apply a device experience associated with an actor to a device associated with the actor.   
     
     
         32 . The method of  claim 31 , further comprising:
 determining whether the received real-time data is associated with one or more existing complex profiles, the one or more existing complex profiles including at least one subset of data representing information associated with the actor; and   in response to a determination that the received real-time data is not associated with any existing complex profiles, generating one or more new complex profiles.   
     
     
         33 . The method of  claim 32 , wherein generating the one or more new complex profiles comprises:
 analyzing the received real-time data from the one or more sensors;   searching for a target actor present in the received real-time data;   collecting data associated with the target actor; and   generating a corresponding complex profile for the target actor based on the collected data.   
     
     
         34 . The method of  claim 32 , further comprising:
 in response to a determination that the received real-time data is associated with a corresponding existing complex profile, update the corresponding existing complex profile with information contained in the received real-time data.   
     
     
         35 . The method of  claim 32 , wherein the at least one subset of data representing information about the actor includes data associated with one or more of social profile information, location information, identification information, age information, interest information, or linked account information of the actor. 
     
     
         36 . The method of  claim 31 , wherein two or more processing models differ in how one or more characteristics of the real-time data are weighted, how one or more types of the real-time data are processed, or both. 
     
     
         37 . The method of  claim 31 , wherein receiving the real-time data from the one or more sensors comprises:
 obtaining audio data from at least one microphone in an environment; and   detecting voice data within the audio data, the voice data being associated with the actor in the environment.   
     
     
         38 . The method of  claim 31 , wherein receiving the real-time data from the one or more sensors comprises:
 obtaining video data from at least one camera in an environment; and   detecting facial data within the video data, wherein the facial data is associated with the actor in the environment.   
     
     
         39 . The method of  claim 31 , further comprising:
 storing one or more of the received real-time data, complex profile data, and the processing model in one or more databases.   
     
     
         40 . A non-transitory computer readable medium storing one or more programs, the one or more programs comprising instructions which, when executed by a processor of a computer system, cause the computer system to perform a method, comprising:
 receiving real-time data from one or more sensors;   determining a capability of a system to process the real-time data, the capability comprising a storage capacity or processing power of the system;   determining a processing speed associated with a desired processing of the real-time data;   selecting a processing model in response to the determined capability and the processing speed; and   processing the real-time data using the selected processing model to apply a device experience associated with an actor to a device associated with the actor.