Source discovery using an intelligent data layer

Abstract

Systems and methods for transaction platforms include various systems interacting with each other and transacting in various ways. A method for configuring and launching a marketplace includes: identifying, by a processing system having one or more processors, an opportunity to facilitate configuration of a new marketplace; receiving marketplace opportunity data, wherein the marketplace opportunity data includes information related to a set of assets of one or more types; determining configuration parameters to be implemented in the new marketplace; determining the feasibility of implementing the configuration parameters in the new marketplace; determining data resources to support the new marketplace; determining an architecture of the new marketplace; determining the configuration of the data resources in a data model for the marketplace; configuring a marketplace object; connecting selected data resources to populate the marketplace object; and launching the new marketplace.

What is claimed is: 
     
         1 . A method of discovering data sources for an intelligent data layer, comprising:
 storing a source discovery data store that maintains a data store storing information about existing data sources in a computer-readable storage system;   capturing data from candidate data sources with an ingestion system;   evaluating content ingested from the candidate data sources for meeting one or more aspects of a target source discovery criteria with an analysis system;   producing a degree of similarity signal indicative of a degree of similarity of the candidate data source to at least one of the existing data sources with a similarity engine;   producing a degree of usefulness signal indicative of a utility of the candidate source for producing at least one intelligence outcome with a relevance engine; and   applying artificial intelligence techniques with an intelligent data layer control tower for determining at least one of ingestion actions for the ingestion system and analysis actions for the analysis engine, and for making a determination of use of the candidate data source.   
     
     
         2 . The method of  claim 1 , wherein the intelligent data layer control tower applies machine learning to train the artificial intelligence techniques. 
     
     
         3 . The method of  claim 1 , wherein the intelligent data layer is integrated into a marketplace system of systems. 
     
     
         4 . The method of  claim 3 , wherein the marketplace system of systems is an automated market orchestration system of systems. 
     
     
         5 . The method of  claim 1 , wherein the intelligent data layer control tower determines that at least one integration action includes capturing information from and about candidate sources. 
     
     
         6 . The method of  claim 1 , wherein the intelligent data layer control tower determines that at least one integration action includes advertising for candidate sources. 
     
     
         7 . The method of  claim 1 , wherein the intelligent data layer control tower determines that at least one integration action includes contacting a plurality of known content sources with sets of criteria that are descriptive of a type of content. 
     
     
         8 . The method of  claim 1 , wherein the ingestion system adapts at least a portion of a set of criteria for seeking a source of data by performing at least one of adjusting a range of a value that is descriptive of target source data, or broadening the set of criteria by abstracting at least one data requirement. 
     
     
         9 . The method of  claim 1 , wherein the intelligent data layer control tower suggests source content discovery criteria based on analysis of existing sources, based on requests for variation of intelligence from consumers of the intelligent data layer, and feedback relating to usefulness of existing sources. 
     
     
         10 . The method of  claim 1 , wherein the ingestion system adapts an original ingestion profile for one or more existing data sources thereby causing ingestion of content from the one or more existing data sources that is excluded from ingestion under the original ingestion profile. 
     
     
         11 . The method of  claim 1 , wherein the ingestion system filters data from the candidate data sources based on compliance with at least a portion of a target content ingestion criteria and forwards data from the candidate data source that is accepted through the filter to the analysis engine. 
     
     
         12 . The method of  claim 11 , wherein the target content ingestion criteria include requirements of a data format, a language, and a minimum precision. 
     
     
         13 . The method of  claim 1 , wherein the ingestion system provides source discovery status information to the intelligent data layer control tower for candidate sources of data. 
     
     
         14 . The method of  claim 1 , wherein the analysis system processes data forwarded by the ingestion system to determine compliance with source discovery criteria. 
     
     
         15 . The method of  claim 14 , wherein the source discovery criteria includes consistency of source terminology. 
     
     
         16 . The method of  claim 14 , wherein the source discovery criteria includes consistency of terminology in the candidate data source to terminology of at least one of the existing data sources. 
     
     
         17 . The method of  claim 14 , wherein the analysis system applies a data stabilization algorithm to a portion of the data from the candidate source, a result of which is compared to a data stability criteria of the source discovery criteria. 
     
     
         18 . The method of  claim 1 , wherein the similarity engine determines a degree of similarity of a portion of the candidate source data and at least one existing source of data by comparing data values of the portion to data values of a portion of an existing source of data. 
     
     
         19 . The method of  claim 1 , wherein a degree of usefulness signal includes a predicted impact on intelligence derivable from the candidate source used by one or more intelligence derivation algorithms. 
     
     
         20 . The method of  claim 1 , wherein the degree of usefulness signal includes an indication that a corresponding candidate source is to be added to a list of approved sources.