Method and System for Aggregating and Managing Data from Disparate Sources in Consolidated Storage

Abstract

Non-limiting example embodiments include methods and systems for acquiring private financial data from multiple disparate sources. The private financial data is normalized, aggregated, preferably enhanced, and stored in secure storage. Entitled entities may retrieve selected private financial data from that secure storage efficiently, flexibility, and rapidly. Examples of financial private data include non-liquidity destination related sources of private data as well as liquidity destination related sources. A non-limiting example of a computer-implemented, consolidated, private financial data service is based on a secure, permission-based, aggregated and consolidated data cloud, which enables provision/distribution to one or more authorized parties with legitimate interests selected portions of the consolidated, private financial data.

1 . A method implemented in an information processing system having multiple processors, the method comprising:
 receiving from multiple data sources at the information processing system private financial data related to financial articles of trade that are tradable on one or more financial markets, where private financial data is exclusively accessible by only a set of entitled entities associated with the private financial data or transactions involving the private financial data, and where the received private financial data from the multiple data sources includes multiple different data formats;   normalizing, via the information processing system, the private financial data in multiple different data formats received from the multiple data sources into a normalized data format and storing the normalized private financial data in storage associated with the information processing system;   processing, via the information processing system, the normalized private financial data with public financial data to provide enhanced private financial data;   storing the enhanced private financial data; and   distributing, via the information processing system, selected portions of the enhanced private financial data to entitled entities with legitimate rights to the selected portions of the enhanced private financial data.   
     
     
         2 . The method in  claim 1 , wherein the private financial data includes one or more of: transactional data, margin requirements or calls, trading position information, ownership information, or a status of third parties as guarantors of, or providers of credit for, specified transactions. 
     
     
         3 . The method in  claim 1 , wherein the public financial data includes one or more of: trading market data, trading reference data, an identity of regulators with a legal right to private financial data as authorized by owners of the private financial data, or guarantors or creditors of transactions giving rise to private financial data. 
     
     
         4 . The method in  claim 1 , wherein the multiple data sources include multiple public trading exchanges and one or more dark pools, and wherein the private financial data is provided in drop copy files associated with the multiple public trading exchanges and the one or more dark pools. 
     
     
         5 . The method in  claim 1 , wherein the processing step further includes processing the normalized private financial data with other, more static private financial data that includes one or more of: custom haircuts, allocation relationships, mappings between clearing and trading accounts, overnight positions, posted collateral, or margin. 
     
     
         6 . The method in  claim 1 , wherein the processing step includes processing the normalized private financial data with public trading market and trading reference data to calculate profit and loss based on underlying market prices or to calculate margin requirements. 
     
     
         7 . The method in  claim 1 , wherein the processing step includes associating the normalized private financial data to entitled entities. 
     
     
         8 . The method in  claim 1 , wherein the information processing system is a scalable cloud computing and storage system. 
     
     
         9 . The method in  claim 8 , wherein the scalable cloud computing and storage system supports multiple participant accounts which are entitled to receive selected portions of the enhanced private financial data, and wherein one of the participant accounts provides selected portions of the enhanced private financial data to one or more recipients external to the scalable cloud computing and storage system. 
     
     
         10 . The method in  claim 8 , wherein the scalable cloud computing and storage system supports multiple participant accounts which are entitled to receive selected portions of the enhanced private financial data,
 wherein the scalable cloud computing and storage system supports multiple vendor accounts, and   wherein one of the participant accounts provides selected portions of the enhanced private financial data to one of the vendor accounts for further processing after which the one vendor account performs the distributing step.   
     
     
         11 . The method in  claim 1 , further comprising receiving a real time query from an entitled entity and providing enhanced private financial data in real time responsive to the real time query to the entitled entity. 
     
     
         12 . The method in  claim 1 , further comprising automatically removing private financial data from the storage associated with the information processing system at a predetermined expiration time. 
     
     
         13 . The method in  claim 1 , further comprising encrypting the normalized private financial data, and wherein the storing step includes storing the encrypted normalized private financial data in secure storage. 
     
     
         14 . The method in  claim 1 , wherein the distributing step includes distributing selected portions of the enhanced private financial data to one or more financial regulatory entities. 
     
     
         15 . An information processing system comprising:
 one or more data processors in communication with a cloud computing and storage platform via a communications network, data storage coupled to the one or more processors,   wherein the one or more data processors are configured to:
 receive from multiple data sources private financial data related to financial articles of trade that are tradable on one or more financial markets, where private financial data is exclusively accessible by only a set of entitled entities associated with the private financial data or transactions involving the private financial data, and where the received private financial data from the multiple data sources includes multiple different data formats; 
 normalize the private financial data in multiple different data formats received from the multiple data sources into a normalized data format; 
 store the normalized private financial data in the cloud computing and storage platform; 
 process or direct the cloud computing and storage platform to process the normalized private financial data with public financial data to provide enhanced private financial data and thereafter store the enhanced private financial data in the cloud computing and storage platform; and 
 direct the cloud computing and storage platform to distribute selected portions of the enhanced private financial data to entitled entities with legitimate rights to the selected portions of the enhanced private financial data. 
   
     
     
         16 . The information processing system in  claim 15 , wherein the one or more data processors are configured to encrypt the normalized private financial data before storing in the cloud computing and storage platform. 
     
     
         17 . The information processing system in  claim 15 , wherein the one or more data processors are configured to process the normalized private financial data with other, more static private financial data that includes one or more of:
 custom haircuts, allocation relationships, mappings between clearing and trading accounts, overnight positions, posted collateral, or margin.   
     
     
         18 . The information processing system in  claim 15 , wherein the one or more data processors are configured to process the normalized private financial data with public trading market and trading reference data to calculate profit and loss based on underlying market prices or to calculate margin requirements. 
     
     
         19 . The information processing system in  claim 15 , wherein the one or more data processors are configured to associate the normalized private financial data to entitled entities. 
     
     
         20 . A financial information processing system comprising:
 one or more data processors coupled to one or more participant interfaces;   a cloud computing and storage platform; and   one or more communications networks providing data communication for the one or more data processors and the cloud computing and storage platform;   wherein the one or more data processors are configured to:
 receive, via the one or more communication networks, from multiple data sources private financial data related to financial articles of trade that are tradable on one or more financial markets, where private financial data is exclusively accessible by only a set of entitled entities associated with the private financial data or transactions involving the private financial data, and where the received private financial data from the multiple data sources includes multiple different data formats; 
 normalize the private financial data in multiple different data formats received from the multiple data sources into a normalized data format; 
 store the normalized private financial data in the cloud computing and storage platform; and 
 process or direct the cloud computing and storage platform to process the normalized private financial data with public financial data to provide enhanced private financial data and thereafter store the enhanced private financial data in the cloud computing and storage platform, 
 wherein the cloud computing and storage platform is configured store the normalized private financial data and to distribute selected portions of the enhanced private financial data to entitled entities with legitimate rights to the selected portions of the enhanced private financial data. 
   
     
     
         21 . The financial information processing system in  claim 20 , wherein the cloud computing and storage platform is configured to support multiple participant accounts which are entitled to receive selected portions of the enhanced private financial data, and
 wherein one of the participant accounts is configured to provide selected portions of the enhanced private financial data to one or more recipients external to the cloud computing and storage platform.   
     
     
         22 . The financial information processing system in  claim 20 , wherein the cloud computing and storage platform is configured to support multiple participant accounts which are entitled to receive selected portions of the enhanced private financial data,
 wherein the cloud computing and storage platform is configured to support multiple vendor accounts, and   wherein one of the participant accounts is configured to provide selected portions of the enhanced private financial data to one of the vendor accounts for further processing after which the one vendor account performs the distributing step.   
     
     
         23 . The financial information processing system in  claim 20 , wherein the cloud computing and storage platform is configured to receive a real time query from an entitled entity and provide enhanced private financial data in real time responsive to the real time query to the entitled entity. 
     
     
         24 . The financial information processing system in  claim 20 , wherein the cloud computing and storage platform is configured to distribute selected portions of the enhanced private financial data to one or more financial regulatory entities. 
     
     
         25 . The financial information processing system in  claim 20 , wherein the cloud computing and storage platform is configured to automatically remove private financial data from storage at a predetermined expiration time. 
     
     
         26 . The financial information processing system in  claim 20 , wherein the cloud computing and storage platform includes a secure, regulated data storage and wherein the cloud computing and storage platform is configured to store encrypted normalized private financial data in the secure, regulated data storage. 
     
     
         27 . The financial information processing system in  claim 20 , wherein the private financial data includes one or more of: transactional data, margin requirements or calls, trading position information, ownership information, or a status of third parties as guarantors of, or providers of credit for, specified transactions. 
     
     
         28 . The financial information processing system in  claim 20 , wherein the public financial data includes one or more of: trading market data, trading reference data, an identity of regulators with a legal right to private financial data as authorized by owners of the private financial data, or guarantors or creditors of transactions giving rise to private financial data. 
     
     
         29 . The financial information processing system in  claim 20 , wherein the multiple data sources include multiple public trading exchanges and one or more dark pools, and wherein the private financial data is provided in drop copy files associated with the multiple public trading exchanges and the one or more dark pools.