Systems and Methods of Constructing a Network Topology

Abstract

The technology disclosed relates to sub-clustering within service clusters in real-time. In particular, it relates to accessing a network topology that records node data and connection data including processes running on numerous hosts grouped into local services on the hosts, the local services running on multiple hosts grouped into service clusters and sub-clusters of service clusters, and network connections used by the service clusters to connect the hosts grouped into service connections, wherein the node data includes software versions of the processes and process data with configuration files and clustering the multiple hosts with the service clusters into the sub-clusters based at least in part on the software versions.

What is claimed is: 
     
         1 . A method of automatically updating a service cluster composition in a network topology in real-time, the method including:
 accessing a network topology that records node and connection data including processes running on numerous hosts grouped into local services on the hosts, the local services running on multiple hosts grouped into service clusters, and network connections used by the service clusters to connect the hosts grouped into service connections;   receiving data, in real-time, that indicates addition of new hosts to a network and that indicates new processes running on the hosts;   classifying the new processes into local services running on the new hosts;   classifying the local services running on the new hosts into service clusters;   assigning at least some of the new hosts into existing instances of the service clusters;   updating the instances of the service clusters in the network topology; and   monitoring the updated instanced of the service clusters.   
     
     
         2 . The method of  claim 1 , further including, after the assigning action:
 queuing the new hosts assigned to the existing instance of the service clusters to be updated to the instance of the service clusters after a new host threshold is reached; and   periodically processing one or more queues from the received data and proceeding with the updating after the new host threshold is reached.   
     
     
         3 . A method of streamlining host monitoring in real-time, the method including:
 accessing a network topology that records node and connection data including processes running on numerous hosts grouped into local services on the hosts, the local services running on multiple hosts grouped into service clusters, and network connections used by the service clusters to connect the hosts grouped into service connections;   detecting from the network topology that a group of interrelated hosts in a service cluster share a critical resource;   summarizing operation of the interrelated hosts by performance of the critical resource; and   generating data for display that includes the performance of the critical resource and an option to drill down to performance of the interrelated hosts that share the critical resource.   
     
     
         4 . The method of  claim 3 , wherein the interrelated hosts share memcached as a critical resource and performance data for display is metrics of memcached, including number of active connections, number of evictions, and cache miss ratio. 
     
     
         5 . A method of sub-clustering within service clusters in real-time, the method including:
 accessing a network topology that records node data and connection data including processes running on numerous hosts grouped into local services on the hosts, the local services running on multiple hosts grouped into service clusters and sub-clusters of service clusters, and network connections used by the service clusters to connect the hosts grouped into service connections;   wherein the node data includes software versions of the processes and process data with configuration files; and   clustering the multiple hosts with the service clusters into the sub-clusters based at least in part on the software versions.   
     
     
         6 . The method of  claim 5 , further including monitoring a sub-cluster for number of active connections with other services outside the service cluster in a time window. 
     
     
         7 . The method of  claim 5 , further including monitoring a sub-cluster for number of connections established with other services outside the service cluster in a time window. 
     
     
         8 . The method of  claim 5 , further including monitoring a sub-cluster for metrics applied to other sub-clusters of the service cluster. 
     
     
         9 . A non-transitory computer readable storage medium impressed with computer program instructions, the instructions, when executed on a processor, implement the method of  claim 1 . 
     
     
         10 . A non-transitory computer readable storage medium impressed with computer program instructions, the instructions, when executed on a processor, implement the method of  claim 3 . 
     
     
         11 . A non-transitory computer readable storage medium impressed with computer program instructions, the instructions, when executed on a processor, implement the method of  claim 5 . 
     
     
         12 . A system including one or more processors coupled to memory, the memory loaded with computer instructions, the instructions, when executed on the processors, implement actions of  claim 1 . 
     
     
         13 . A system including one or more processors coupled to memory, the memory loaded with computer instructions, the instructions, when executed on the processors, implement actions of  claim 3 . 
     
     
         14 . A system including one or more processors coupled to memory, the memory loaded with computer instructions, the instructions, when executed on the processors, implement actions of  claim 5 .