Intelligent data layer system

Abstract

Systems and methods for transaction platforms include various systems interacting with each other and transacting in various ways. A method for configuring and launching a marketplace includes: identifying, by a processing system having one or more processors, an opportunity to facilitate configuration of a new marketplace; receiving marketplace opportunity data, wherein the marketplace opportunity data includes information related to a set of assets of one or more types; determining configuration parameters to be implemented in the new marketplace; determining the feasibility of implementing the configuration parameters in the new marketplace; determining data resources to support the new marketplace; determining an architecture of the new marketplace; determining the configuration of the data resources in a data model for the marketplace; configuring a marketplace object; connecting selected data resources to populate the marketplace object; and launching the new marketplace.

What is claimed is: 
     
         1 . An intelligent data layer system, comprising:
 a computer-readable storage system that stores a layer configuration data store that maintains:
 ingestion parameters including one or more data structures that represent aspects of one or more of a plurality of data sources including a source location, an interface protocol, a source data ontology, and an ingestion cost; 
 parsing rules that facilitate determining one or more of structure, content, relationships among data elements, intended meaning of the data elements, or relationships of data, structure, and intended meaning; and 
 one or more analysis algorithms; and 
   a set of one or more processors that execute a set of computer-readable instructions, wherein the set of one or more processors collectively:
 receive an intelligence request from an intelligence consumer portal; 
 determine at least one data source for deriving intelligence for the consumer portal based on the received request; 
 configure an ingestion system based on the ingestion parameters and parsing rules in the layer configuration data store for the at least one data source; 
 configure an analysis system based on the analysis algorithms in the layer configuration data store for the at least one data source; 
 configure an intelligence deriving system based on information in the request and available intelligence services in an intelligence service system; and 
 operate the system to ingest data from the at least one data source using the ingestion system, analyze the ingested data from the at least one data source using the analysis system, derive a set of intelligence data from at least one of the ingested data form the at least one data source and an outcome of using the analysis system, and communicating the set of intelligence data to at least one of the consumer portal or an intelligent data layer store. 
   
     
     
         2 . The intelligent data layer system of  claim 1 , wherein the computer-readable storage system stores an intelligent data layer store that maintains results of operations of one or more systems of the intelligent data layer system. 
     
     
         3 . The intelligent data layer system of  claim 2 , wherein the one or more systems includes the ingestion system, the analysis system, and the intelligence deriving system. 
     
     
         4 . The intelligent data layer system of  claim 3 , wherein the result of operations includes intermediate results of at least one of the one or more systems and at least one role-adapted final result variant of the intermediate results. 
     
     
         5 . The intelligent data layer system of  claim 1 , wherein to configure the analysis system is further based on consumer intelligence objectives of the request. 
     
     
         6 . The intelligent data layer system of  claim 1 , wherein the set of one or more processors is configured in an intelligent data layer control tower that configures and operates the intelligent data layer system by communicating control sequences with the ingestion system, the analysis system, and the intelligence deriving system. 
     
     
         7 . The intelligent data layer system of  claim 1 , wherein the ingestion system parses content of data sources to determine structure of the content and relationships among elements in the data. 
     
     
         8 . The intelligent data layer system of  claim 1 , wherein the ingestion system parsing a content of data sources results in generating characterization data that includes an intended meaning of elements of the data and relationships among the data, structures of the data, and meaning of the data parsed from the content. 
     
     
         9 . The intelligent data layer system of  claim 1 , wherein the ingestion system assigns a relationship attribute to a pair of data values that are configured as parent/child in a hierarchy of the data source. 
     
     
         10 . The intelligent data layer system of  claim 1 , wherein the ingestion system is configured to maintain a schedule of collection activity for one or more data sources. 
     
     
         11 . The intelligent data layer system of  claim 1 , wherein the ingestion system is configured to parse source data according to at least one of a specification of the source or a context of a supply chain for an ingestion instance of the source data. 
     
     
         12 . The intelligent data layer system of  claim 1 , wherein the ingestion system communicates ingested data, results of ingestion, and results of parsing, to an intelligent data layer control tower of the system. 
     
     
         13 . The intelligent data layer system of  claim 1 , wherein the location of the data source is a source address selected from a list of source addresses consisting of a universal record locator, port number, stream identifier, publication and/or broad channel, sensor output address. 
     
     
         14 . The intelligent data layer system of  claim 1 , wherein the analysis system compares data from the data source against a target use of intelligence derived from a data source to determine a degree of fitness for use of the data source by the intelligence deriving system. 
     
     
         15 . The intelligent data layer system of  claim 1 , wherein the analysis system analyzes ingestion system results for meeting at least one consumption target requirement of the consumer portal request. 
     
     
         16 . The intelligent data layer system of  claim 15 , wherein the consumption target requirement includes one or more of a validity time constraint, an accuracy constraint, a frequency of update constraint, or relevance to a consumption subject matter focus. 
     
     
         17 . The intelligent data layer system of  claim 1 , wherein the analysis system configures data regarding the ingested data for one or more system uses from a list of uses including advertisements that characterize the ingested data in terms of potential intelligence value, indexing schemes for offering intelligence derived data in a marketplace, searching intelligence derived data by identifying keywords, terms, and values associated with the ingested data. 
     
     
         18 . The intelligent data layer system of  claim 1 , wherein the analysis system estimates a value of intelligence data derived from the ingested data for a range of consumer portals to enable setting costs for consuming the intelligence data derived from the ingested data. 
     
     
         19 . The intelligent data layer system of  claim 1 , wherein one or more systems of the intelligent data layer is configured as a micro-service architecture for isolated and independent operation of instances of the one or more systems for a plurality of distinct consumer portals. 
     
     
         20 . The intelligent data layer system of  claim 19 , wherein the one or more systems of the intelligent data layer system is initiated as a virtualized container to perform system-specific intelligent data layer system functions. 
     
     
         21 . The intelligent data layer system of  claim 20 , wherein the virtualized container is configured with a consumer portal-specific instance of at least one of the ingestion system, the analysis system, or the intelligence deriving system. 
     
     
         22 . The intelligent data layer system of  claim 1 , wherein the intelligent data layer system ingests data from a plurality of types of data sources including data channels, on-demand data sources, and published data sources. 
     
     
         23 . The intelligent data layer system of  claim 22 , wherein an intelligent data layer control tower adapts a configuration of the ingestion system based on a type of data source for a data source selected by the intelligent data layer control tower for each of a plurality of instances of ingestion. 
     
     
         24 . The intelligent data layer system of  claim 1 , wherein an intelligent data layer control tower adapts a configuration of the ingestion system, the analysis system, and the intelligence deriving system. 
     
     
         25 . The intelligent data layer system of  claim 1 , wherein the intelligent data layer ingests data differently from a single data source based on ingestion requirements accessible through the request. 
     
     
         26 . The intelligent data layer system of  claim 1 , wherein the intelligent data layer system further includes a plurality of system-focused probes that provide near real-time context of a range of aspects of system services. 
     
     
         27 . The intelligent data layer system of  claim 26 , wherein the system-focused probes include probes that monitor source data for source data impacting activity and that signal to an intelligent data layer control tower for taking action within the system based on a projected impact of the source data impacting activity. 
     
     
         28 . The intelligent data layer system of  claim 26 , wherein the system-focused probes monitor for time-related triggers for data sources, including early release of an update of source data, delayed release of an update of source data, and an announcement of new sources of data. 
     
     
         29 . The intelligent data layer system of  claim 1 , wherein the ingestion system monitors a port on a data network for an indication of data availability at a data source. 
     
     
         30 . The intelligent data layer system of  claim 1 , wherein the system develops a multi-dimensional understanding of source data value by applying a value determination cross matrix that facilitates mapping a data source-relevant value of the source data to a consumer portal-relevant value of the source data.