Systems and methods for content origin administration

Abstract

Methods and systems for storing and distributing content include executing storage rules against ingested content to determine in which of a plurality of storage systems to store the ingested content. A metadata collection that includes records corresponding to the stored content is maintained such that the content may be located by querying or otherwise searching the metadata collection. The metadata collection may be analyzed using various criteria to identify content to be migrated between different storage systems.

We claim: 
     
         1 . A method of storing content comprising:
 identifying a first storage system of a plurality of storage systems for storing content received from a content provider by applying one or more first storage rules to data corresponding to the content, the content provider, and the plurality of storage systems;   initiating transfer of the content to the first storage system; and   adding a metadata record to a metadata collection, the metadata record including a first storage system identifier assigned to the first storage system and an object identifier assigned to the content.   
     
     
         2 . The method of  claim 1  further comprising:
 receiving the content from a content provider at an ingest server, the ingest server communicatively coupled to each of a content delivery network (CDN) origin server and the plurality of storage systems, 
 wherein the first storage system is a third-party cloud storage system, the ingest server applies the one or more first rules to the content, and the ingest server initiates transfer of the content to the first storage system. 
 
     
     
         3 . The method of  claim 1 , wherein updating the metadata collection to include the metadata record comprises at least one of creating the metadata record or modifying the metadata record. 
     
     
         4 . The method of  claim 1  further comprising:
 initiating migration of the content from the first storage system to a second storage system of the plurality of storage systems; and 
 updating the metadata collection by one of modifying the metadata record to replace the first storage system identifier with a second storage system identifier assigned to the second storage system and replacing the metadata record with a new metadata record including the second storage system identifier and the object identifier. 
 
     
     
         5 . The method of  claim 4 , wherein the second storage system has different performance characteristics from the first storage system, and initiating migration of the content comprises identifying the second storage system by applying one or more second storage rules to second data corresponding to the content, the content provider, and the plurality of storage systems. 
     
     
         6 . The method of  claim 5 , wherein the second data corresponds, at least in part, to the content and the second data is obtained, at least in part, from the metadata collection. 
     
     
         7 . The method of  claim 1 , wherein:
 the one or more first storage rules define logical tests that may be applied to one or more of content data, content provider data, and storage system data to generate a rule result, the rule result identifying a storage system of the plurality of storage systems;   identifying the first storage system comprises obtaining the data corresponding to at least one of the content, the content provider, and the first storage system; and   obtaining a rule result for the content by applying the first storage rules to the data, the rule result for the content identifying the first storage system.   
     
     
         8 . The method of  claim 1 , wherein the one or more first storage rules are based on one or more of:
 a size of the content;   a type of the content;   a frequency with which the content is requested;   a frequency with which the content is modified;   an age of the content;   a preference of the content provider;   one or more first terms of a first service agreement for making the content available over a content delivery network (CDN);   one or more second terms of one or more second service agreements for storing content on the plurality of storage systems;   a speed for retrieving the content once stored;   a storage cost for storing the content; and   a level of security applied to the content once stored.   
     
     
         9 . The method of  claim 1  further comprising, in response to receiving a metadata request including an object identifier corresponding to a piece of stored content, providing one or more metadata records of the metadata collection associated with the object identifier. 
     
     
         10 . The method of  claim 1 , wherein initiating storage of the content on the first storage system comprises initiating storage of a first portion of the content, the method further comprising:
 identifying a second file storage system for storing the content by applying one or more second storage rules to the content; and   initiating storage of a second portion of the content on the second storage system.   
     
     
         11 . The method of  claim 10 , wherein the first portion of the content includes one or more transport segments and the second portion of the content includes a manifest file including entries for the one or more transport segments. 
     
     
         12 . A method of serving content comprising:
 receiving a request from a client device for requested content stored in a storage system of a plurality of storage systems in communication with a content distribution network (CDN), the request including a requested object identifier for the requested content;   performing a lookup in a metadata collection for a storage system identifier using the requested object identifier, the metadata collection including a plurality of metadata records for content stored in the plurality of storage systems, a metadata record of the plurality of metadata records including each of the requested object identifier and the storage system identifier for the storage system on which the requested content is stored;   locating the requested content using the storage system identifier; and   copying the requested content to the CDN.   
     
     
         13 . The method of  claim 12 , further comprising:
 serving the requested content to the client device from the CDN, and   updating access information for the requested content stored in the metadata record, the access information including at least one of a number of times the requested content has been requested and a time of a most recent request for the requested content.   
     
     
         14 . The method of  claim 13 , wherein copying the requested content to the CDN comprises creating a cache of the requested content at an edge device of the CDN, and serving the requested content to the client device comprises serving the client device from the cache. 
     
     
         15 . The method of  claim 14 , further comprising:
 receiving a second request for the requested content from a second client device; and   serving the requested content to the second client device form the cache.   
     
     
         16 . The method of  claim 13 , wherein the requested content includes a plurality of transport segments and a manifest file including entries for each of the plurality of transport segments, and serving the requested content from the CDN comprises:
 serving the manifest file to the client device in response to the request for the requested content; and   serving one or more of the plurality of transport segments in response to one or more subsequent requests for the transport segments received from the client device.   
     
     
         17 . The method of  claim 12 , further comprising:
 receiving a metadata request from a second client device, the metadata request including the requested object identifier;   retrieving the metadata record corresponding to the requested content from the metadata collection; and   transmitting data contained within the metadata record to the second client device.   
     
     
         18 . The method of  claim 12 , wherein the storage system is a third-party cloud storage system. 
     
     
         19 . The method of  claim 18 , wherein content stored on the storage system is accessible through a web server, the method further comprising:
 generating a third-party cloud storage system request for the requested content;   submitting the third-party cloud storage system request to the web server; and   obtaining a copy of the requested content from the third-party cloud storage system.   
     
     
         20 . A system for storing content comprising:
 a metadata collection for storing metadata records, each metadata record corresponding to stored content maintained in a plurality of storage systems; and   an ingress server communicatively coupled to the metadata collection, the ingress server comprising a processor and one or more non-transitory tangible computer-readable storage media storing computer-executable instructions that, when executed by the processor, cause the ingress server to:
 identify a storage system of a plurality of storage systems on which to store content by applying one or more storage rules to at least one of the content and metadata records of the metadata collection; 
 initiate transfer of the content to the storage system; and 
 update the metadata collection to include a metadata record for the content, the metadata record including a storage system identifier corresponding to the storage system and an object identifier corresponding to the content. 
   
     
     
         21 . A system for serving content comprising:
 a content delivery server of a content delivery network (CDN), the content delivery server comprising a processor and one or more non-transitory tangible computer-readable storage media storing computer-executable instructions that, when executed by the processor, cause the content delivery server to:
 receive a request for content stored on a storage system of a plurality of storage systems; 
 obtain a storage system identifier from a metadata collection, the metadata collection including one or more metadata records corresponding to content stored on the plurality of storage systems, the storage system identifier corresponding to the storage system on which the content is stored; and 
 serve the stored content based on the storage system identifier, wherein serving the stored content comprises at least one of retrieving the stored content from the storage system and serving a cached version of the stored content maintained within the CDN. 
   
     
     
         22 . The system of  claim 20 , further comprising a web server communicatively coupled to each of the content delivery server and the metadata collection, the web server configured to:
 receive a storage system identifier request from the content delivery server, the storage identifier request including an object identifier corresponding to the stored content;   identify the storage system identifier by performing a look up in the metadata collection using the object identifier; and   transmit the storage system identifier to the content delivery server.