Transfer of data streaming services to provide continuous data flow

Abstract

Embodiments regard transfer of data streaming services to provide continuous data flow. An embodiment of an apparatus includes a processor to process data for streaming to one or more organizations; and a memory to store data for streaming to the one or more organizations, wherein the apparatus is to provide a centralized work distribution service to track status of each of a plurality of data streams to the one or more organizations, and a plurality of nodes, each node being a virtual machine to stream one or more data streams to the one or more organizations, each node including a first daemon service to monitor connectivity of the node to dependency services for the node and, upon detecting a loss of connection to one or more of the dependency services, the node to discontinue ownership of the one or more data streams of the node and a second daemon service to poll the centralized work distribution service for data streams that are not assigned.

1 - 20 . (canceled) 
     
     
         21 . An apparatus comprising:
 a processor to process data for streaming to one or more organizations; and   a memory to store data for streaming to the one or more organizations, wherein the apparatus is to provide:
 a work distribution service to distribute and track a state of each of a plurality of data streams to the one or more organizations, and 
 a plurality of nodes, each node including a virtual machine having capability to service a plurality of data streams to the one or more organizations; and 
   wherein each node of the plurality of nodes including a plurality of services, the services including:
 a first service to monitor connectivity of the node to a plurality of services that are required for operation of the node and, upon detecting a loss of connection to any of the required services for the node, the node to discontinue ownership of all data streams being serviced by the node; and 
 a second service to poll the work distribution service for data streams that are not assigned to allow the node to obtain ownership of one or more unassigned data streams. 
   
     
     
         22 . The apparatus of  claim 21 , wherein, upon a first node obtaining ownership of a unassigned first data stream, the first node is to obtain state information for servicing of the first data stream. 
     
     
         23 . The apparatus of  claim 22 , wherein the first node is to utilize the state information to determine a starting point to continue data streaming for the first data stream. 
     
     
         24 . The apparatus of  claim 21 , wherein servicing of a data stream to an organization is limited to a single node of the plurality of nodes at any time. 
     
     
         25 . The apparatus of  claim 21 , wherein the nodes of the plurality of nodes do not communicate with each other, and wherein each node of the plurality of nodes operates independently from the other nodes of the plurality of nodes. 
     
     
         26 . The apparatus of  claim 21 , wherein the plurality of nodes exists in a cloud computing platform. 
     
     
         27 . The apparatus of  claim 21 , wherein the plurality of required services for a node include one or more of a database service, a coordination service, and a cache service. 
     
     
         28 . The apparatus of  claim 21 , wherein one or more data streams of each node including data representing changes occurring on a customer relationship management (CRM) system. 
     
     
         29 . A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:
 tracking of a status of a plurality of data streaming jobs for one or more organizations by a central work distribution service, the data streaming jobs being serviced by a plurality of nodes, each node including a virtual machine having capability to service a plurality of data streams to the one or more organizations;   polling of the central work distribution service for available data streaming jobs by a first service of each of the plurality of nodes, the central work distribution service to assign available data streaming jobs to the nodes in response to the polling;   monitoring of a plurality of services that are required for node operation by a second service of each node; and   upon the second service of a first node detecting loss of connectivity with any of the required services for the first node, discontinuing ownership by the first node of all data streaming jobs being serviced by the first node, the central work distribution service changing the status of all data streaming jobs of the first node to available.   
     
     
         30 . The medium of  claim 29 , further comprising instructions that, when executed by the processor, cause the processor to perform operations comprising:
 upon a first node obtaining ownership of a unassigned first data stream, obtaining state information by the first node for servicing of the first data stream.   
     
     
         31 . The medium of  claim 30 , further comprising instructions that, when executed by the processor, cause the processor to perform operations comprising:
 utilizing the state information by the first node to determine a starting point to continue data streaming for the first data stream.   
     
     
         32 . The medium of  claim 29 , wherein servicing of a data streaming job to an organization is limited to a single node of the plurality of nodes at any time. 
     
     
         33 . The medium of  claim 29 , wherein the nodes of the plurality of nodes do not communicate with each other, and wherein each node of the plurality of nodes operates independently from the other nodes of the plurality of nodes. 
     
     
         34 . The medium of  claim 29 , wherein the plurality of required services for a node include one or more of a database service, a coordination service, and a cache service. 
     
     
         35 . A system comprising:
 data storage for system data and tenant data;   a processor system to process data for streaming to one or more organizations;   a network interface to provide connection with one or more user systems; and   a memory to store data for streaming to the one or more organizations, wherein the system is to provide:
 a work distribution service to distribute and track a state of each of a plurality of data streams to the one or more organizations, and 
 a plurality of nodes, each node including a virtual machine having capability to service a plurality of data streams to the one or more organizations; and 
   wherein each node of the plurality of nodes including a plurality of services, the services including:
 a first service to monitor connectivity of the node to a plurality of services that are required for operation of the node and, upon detecting a loss of connection to any of the required services for the node, the node to discontinue ownership of all data streams being serviced by the node; and 
 a second service to poll the work distribution service for data streams that are not assigned to allow the node to obtain ownership of one or more unassigned data streams. 
   
     
     
         36 . The system of  claim 35 , wherein, upon a first node obtaining ownership of a unassigned first data stream, the first node is to obtain state information for servicing of the first data stream. 
     
     
         37 . The system of  claim 36 , wherein the first node is to utilize the state information to determine a starting point to continue data streaming for the first data stream. 
     
     
         38 . The system of  claim 35 , wherein servicing of a data stream to an organization is limited to a single node of the plurality of nodes at any time. 
     
     
         39 . The system of  claim 35 , wherein the nodes of the plurality of nodes do not communicate with each other, and wherein each node of the plurality of nodes operates independently from the other nodes of the plurality of nodes. 
     
     
         40 . The system of  claim 35 , wherein the plurality of required services for a node include one or more of a database service, a coordination service, and a cache service.