Real-time large volume data correlation

Abstract

A system and method uses a data correlator system to associate large volumes of related data. The data correlator system receives data packets with user content from a mobile network. The data correlator system creates a hash value for data associated with the user content, such as user account information or the location of the user device. The data correlator system uses the hash value to combine the user content with the associated data. The data correlator system provides the combined data to an optimization engine for optimizing the performance of the mobile network.

What is claimed is: 
     
         1 . A computing system comprising:
 a data correlator;   a first data feed queue that supplies a first data packet from a network connection to the data correlator, wherein the first data packet comprises a key data element, wherein the first data packet further comprises a user plane data element or a control plane data element;   a data mapper; and   a second data feed queue that supplies a second data packet to the data mapper, wherein the second data packet comprises the key data element and a user identifier data element,   wherein the data mapper creates a hash value for the second data packet;   wherein the data correlator uses the hash value and the key data element to identify the second data packet and combines the first data packet and the second data packet to create a combined data packet comprising the user identifier data element and at least one of: the user plane data element or the control plane data element; and   wherein the data correlator provides the combined data packet to an external client.   
     
     
         2 . The computing system of  claim 1 , wherein the key data element comprises a device network identifier. 
     
     
         3 . The computing system of  claim 1 , wherein the user plane data element comprises a portion of one of: an image, a video frame, or text. 
     
     
         4 . The computing system of  claim 1 , wherein the user identifier data element comprises one of: a telephone number, an international mobile equipment identity code, an international mobile subscriber identity code, a name, or an account number. 
     
     
         5 . The computing system of  claim 1 , wherein the user identifier data element is retrieved from a user database. 
     
     
         6 . The computing system of  claim 1 , wherein the external client comprises an optimization engine, wherein the optimization engine uses the control plane data element and the key data element to identify a first cell location of a device and to transfer the device to a second cell location within a communication network. 
     
     
         7 . The computing system of  claim 1 , wherein the computing system further comprises:
 a second data correlator; and   a third data feed queue that supplies a third data packet to the second data correlator, wherein the third data packet comprises the key data element and one of: the user plane data element or the control plane data element that is absent from the first data packet;   wherein the second data correlator uses the hash value and the key data element to identify the third data packet and to combine the third data packet and the second data packet to create a combined second data packet comprising the user identifier data element and the one of: the user plane data element or the control plane data element that is absent from the first data packet; and   wherein the second data correlator provides the combined second data packet to the external client.   
     
     
         8 . The computing system of  claim 1 , further comprising:
 a second data correlator; and   a second data mapper;   wherein the second data correlator receives the combined data packet from the data correlator;   wherein the second data mapper receives a third data packet, wherein the third data packet comprises the key data element and one of: the user plane data element or the control plane data element that is absent from the first data packet;   wherein the second data mapper creates a second hash value for the third data packet;   wherein the second data correlator uses the second hash value and the key data element to identify the third data packet and to combine the combined data packet and the third data packet to create a second combined data packet comprising the user identifier data element, the user plane data element, and the control plane data element; and   wherein the second data correlator provides the second combined data packet to the external client.   
     
     
         9 . The computing system of  claim 8 , wherein the control plane data element comprises one of: a network performance measurement or location data. 
     
     
         10 . The computing system of  claim 1 , further comprising a delayed data correlator, wherein the delayed data correlator:
 receives a third data packet from the data correlator when the data correlator is unable to combine the third data packet and a fourth data packet;   receives a second hash value from the data mapper;   uses the second hash value and the key data element to identify the third data packet and to combine the third data packet received from the data correlator and the fourth data packet received at the data mapper to create a delayed combined data packet comprising the user identifier data element and one of: the user plane data element or the control plane data element; and   provides the delayed combined data packet to the external client.   
     
     
         11 . A method comprising:
 receiving, from a network connection, a first data packet at a data correlator, wherein the first data packet comprises a key data element, wherein the first data packet further comprises a user plane data element or a control plane data element, and wherein the data correlator executes on at least one processor; and   receiving a second data packet at a data mapper, the data mapper executing on the at least one processor, wherein the second data packet comprises the key data element and a user identifier data element;   creating, by the data mapper, a hash value for the second data packet;   identifying, by the data correlator, the second data packet by using the hash value and the key data element;   combining, by the data correlator, the first data packet and the second data packet to create a combined data packet comprising the user identifier data element and the user plane data element or the control plane data element; and   providing the combined data packet to an external client.   
     
     
         12 . The method of  claim 11 , wherein the key data element comprises a device network identifier. 
     
     
         13 . The method of  claim 11 , wherein the user plane data element comprises a portion of one of: an image, a video frame, or text. 
     
     
         14 . The method of  claim 11 , wherein the user identifier data element comprises one of: a telephone number, an international mobile equipment identity code, an international mobile subscriber identity code, a name, or an account number. 
     
     
         15 . The method of  claim 11 , wherein the user identifier data element is retrieved from a user database. 
     
     
         16 . The method of  claim 11 , wherein the external client comprises an optimization engine, wherein the optimization engine uses the control plane data element and the key data element to identify a first cell location of a device and to transfer the device to a second cell location within a communication network. 
     
     
         17 . The method of  claim 11 , further comprising:
 receiving a third data packet at a second data correlator, wherein the third data packet comprises the key data element and one of: the user plane data element or the control plane data element that is absent from the first data packet;   identifying, by the second data correlator, the third data packet by using the hash value and the key data element;   combining, by the second data correlator, the second data packet and the third data packet to create a combined second data packet comprising the user identifier data element and the one of: the user plane data element or the control plane data element that is absent from the first data packet; and   providing, by the second data correlator, the combined second data packet to the external client.   
     
     
         18 . The method of  claim 11 , further comprising:
 receiving, at a second data correlator, the combined data packet from the data correlator;   receiving, at a second data mapper, a third data packet, wherein the third data packet comprises the key data element and one of: the user plane data element or the control plane data element that is absent from the first data packet;   creating, by the second data mapper, a second hash value for the third data packet;   identifying, by the second data correlator, the third data packet by using the second hash value and the key data element;   combining, by the second data correlator, the combined data packet and the third data packet to create a second combined data packet comprising the user identifier data element, the user plane data element, and the control plane data element; and   providing, by the second data correlator, the second combined data packet to the external client.   
     
     
         19 . The method of  claim 18 , wherein the control plane data element comprises one of:
 a network performance measurement or location data.   
     
     
         20 . A non-transitory computer-readable medium storing instructions which, when executed by a computing system including at least one processor, cause the computing system to perform operations, the operations comprising:
 receiving, from a network connection, a first data packet, wherein the first data packet comprises a key data element, wherein the first data packet further comprises a user plane data element or a control plane data element; and   receiving a second data packet, wherein the second data packet comprises the key data element and a user identifier data element;   creating a hash value for the second data packet;   identifying the second data packet by using the hash value and the key data element;   combining the first data packet and the second data packet to create a combined data packet comprising the user identifier data element and the user plane data element or the control plane data element; and   providing the combined data packet to an external client.