Quantization of Data Streams of Instrumented Software

Abstract

A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

We claim: 
     
         1 . A method for processing data streams generated by instrumented software, the method comprising:
 receiving, a plurality of input data streams, each input data stream received from an instance of instrumented software executing on an external system, each data stream providing values of a metric, the values generated at variable time intervals;   receiving a request to periodically evaluate an expression based on data values of the input data streams;   for each input data stream, identifying a function for aggregating values of the metric of the input data stream;   generating a plurality of quantized data streams based on the input data streams, each quantized data stream comprising data values occurring periodically at a fixed time interval, the generating comprising, for each fixed time interval, for each input data stream, determining a data value of the quantized data stream for the fixed time interval, comprising:
 determining an aggregate value by applying the identified function over data values of the input data stream received within the fixed time interval; and 
   periodically evaluating the expression based on data values of the plurality of quantized data streams.