Meta Data Driven Feed Architecture

Abstract

A feed management system is provided that includes a first application module receiving from a user a plurality of fields for processing. The first application module reads meta data from one or more database servers so as to form configuration data for extracting information from the one or more database servers. A generic feed program receives the configuration data and invokes a plurality of extractions of feed data from the one or more database servers. The generic feed program generates one or more feed files associated with the extractions of feed data.

What is claimed is: 
     
         1 . A feed management system comprising:
 a first application module that receives from a user a plurality of fields for processing, the first application module reads meta data from one or more database servers so as to form configuration data for extracting information from the one or more database servers, wherein the configuration data represents the precise structure of the one or more database servers as well as the data from the one or more database servers so as to permit the first application to build a meta data model for feeds; and   a generic feed program that resolves the feed meta data model and invokes a plurality of extractions of feed data from the one or more database servers, to generate a plurality of feed files associated with the extractions of feed data, the generic feed program uses the feed meta data model to extract data from the one or more database servers, the feed meta data model includes denormalized representations of the extracted data minimizing access across disparate database platforms, the generic feed program utilizes batch job processing to generate the feed files.   
     
     
         2 . The management system of  claim 1 , wherein the first application module comprises a web based application. 
     
     
         3 . The management system of  claim 1 , wherein the configuration data comprises SQL custom views used in the extractions of feed data. 
     
     
         4 . The management system of  claim 1 , wherein the first application module comprises a canonical model for performing multiple joins at the one or more database servers. 
     
     
         5 . The management system of  claim 1 , wherein the generic feed program receives an event from a feed orchestrator to perform the extractions of feed data. 
     
     
         6 . The management system of  claim 1 , wherein the feed orchestrator ensures data is ready for extraction. 
     
     
         7 . The management system of  claim 1 , wherein the first application module and the generic feed program execute in different phases of the feed management system. 
     
     
         8 . The management system of  claim 7 , the first application module executes in the configuration phase of the feed management system. 
     
     
         9 . The management system of  claim 7 , the generic feed program executes in the runtime phase of the feed management system. 
     
     
         10 . The management system of  claim 7 , the first application module and generic feed program are platform independent. 
     
     
         11 . A method of generation a plurality feeds using the single instance of a generic feed program:
 receiving from a user a plurality of fields for processing,   using a first application module, meta data is read from one or more database servers so as to build a data feed meta data model for extracting information from the one or more database servers, wherein the feed meta data model represents the precise structure of the feed and its associated feed parameters that are necessary to resolve data for feed generation;   receiving the feed meta data model, the generic program invokes a plurality of extractions of feed data from the one or more database servers, the generic feed program generates a plurality of feed files associated with the extractions of data, the generic feed program uses the feed meta data model to extract data from the one or more database servers, the feed meta data model includes denormalized representations of the extracted data minimizing access across disparate database platforms, the generic feed program utilizes batch job processing to generate the feed files.   
     
     
         12 . The method of  claim 11 , wherein the first application module comprises a web based application. 
     
     
         13 . The method of  claim 11 , wherein the configuration data comprises SQL custom views used in extraction. 
     
     
         14 . The method of  claim 11 , wherein the first application module comprises a canonical model for performing multiple joins at the one or more database servers. 
     
     
         15 . The method of  claim 11 , wherein the generic feed program receives an event from a feed orchestrator to perform extraction. 
     
     
         16 . The method of  claim 11 , wherein the feed orchestrator ensures data is ready for extraction. 
     
     
         17 . The method of  claim 11 , wherein the first application module and the generic feed program execute in different phases of the feed method. 
     
     
         18 . The method of  claim 17 , the first application module and generic feed program are platform independent. 
     
     
         19 . A feed management system comprising:
 a first phase that allows a user to enter a plurality of fields that is provided to a first application module as input, the first application module uses information from the fields to read meta data from one or more database servers so as to build a data feed meta data model for extracting information from the one or more database servers, wherein the feed meta data model represents the precise structure of the feed and its associated feed parameters that are necessary to resolve data for feed generation; and   a second phase that receives the configuration from the first phase, the second phase generates a signal that informs a generic feed program to invoke a plurality of extractions of feed data from the one or more database servers, the generic feed program generates a plurality of feed files associated with the extractions of feed data, the generic feed program uses the feed meta data model to extract data from the one or more database servers, the feed meta data model includes denormalized representations of the extracted data minimizing access across disparate database platforms, the generic feed program utilizes batch job processing to generate the feed files.   
     
     
         20 . The management system of  claim 19 , wherein the first application module comprises a web based application. 
     
     
         21 . The management system of  claim 19 , wherein the configuration data comprises SQL custom views used in the extractions of feed data. 
     
     
         22 . The management system of  claim 19 , wherein the first application module comprises a canonical model for performing multiple joins at the one or more database servers. 
     
     
         23 . The management system of  claim 19 , wherein the generic feed program receives the signal from a feed orchestrator to perform the extractions of feed data. 
     
     
         24 . The management system of  claim 19 , wherein the feed orchestrator ensures data is ready for extraction. 
     
     
         25 . The management system of  claim 19 , the first application module and generic feed program are platform independent.