Regression test suite reduction for cloud systems

Abstract

The disclosure relates to a method, system and computer readable media for validating that a configuration of a cloud system meets requirements, using a reduced test suite selected from a test suite. The method includes classifying the requirements and service instances realizing the requirements composing the cloud system. The method includes applying test suite reduction rules to the test suite, using the classified requirements and service instances, to obtain the reduced test suite. The method includes applying the reduced test suite to the cloud system configured with the configuration, thereby validating that the configuration of the cloud system meets the requirements.

The invention claimed is: 
     
       1. A method for validating that a configuration of a cloud system meets requirements, using a reduced test suite selected from a test suite, the method comprising:
 classifying using a memory and a processing circuitry, requirements and service instances realizing the requirements composing the cloud system; 
 applying, using the memory and the processing circuitry, test suite reduction rules to the test suite, using the classified requirements and service instances, to obtain the reduced test suite; 
 applying, using the memory and the processing circuitry, the reduced test suite to the cloud system configured with the configuration, thereby validating that the configuration of the cloud system meets the requirements and causing signaling between hardware nodes and radio units via the memory and the processing circuitry, wherein the step of classifying the service instances further comprises classifying the service instances among: a service instance directly impacted by a change, a service instance indirectly impacted by the change and a service instance not impacted by the change, wherein classifying the service instance is done using an applicability matrix which maps test cases to service instances to which the test cases are applicable and using a requirement-service matrix which maps every requirement to the service instance realizing the requirement; and 
 removing an applicability link between the service instance and a test case which realizes a requirement if the requirement is directly or indirectly impacted, the requirement is environment dependent, and there is an entry in a history consisting of a test case, a requirement, and a set of configuration parameters identical to the set of configuration parameters that are associated with the service instance and that impacts the requirement. 
 
     
     
       2. The method of  claim 1 , wherein the step of classifying the requirements further comprises classifying the requirements among: environment agnostic requirements, environment dependent requirements and composite requirements, wherein classifying the requirements further comprises classifying configuration parameters as environment agnostic or environment dependent configurations parameters and mapping every requirement that is realized by the cloud system to a configuration parameter to which it is related. 
     
     
       3. The method of  claim 2 , wherein the step of classifying the requirements further comprises classifying the requirements among: directly impacted requirements, indirectly impacted requirements and unimpacted requirements based on the classification of the service instances. 
     
     
       4. The method of  claim 1 , wherein the step of classifying the requirements further comprises classifying the requirements among: directly impacted requirements, indirectly impacted requirements and unimpacted requirements based on the classification of the service instances. 
     
     
       5. The method of  claim 1 , wherein the step of applying test suite reduction rules further comprises reducing the applicability matrix by:
 removing all the service instances realizing the requirement which are not impacted by the change; and 
 removing an applicability link between the service instance and a test case which realizes a requirement if
 the requirement is directly impacted, the requirement is environment agnostic, and there is an entry in the history consisting of a test case, a requirement, and a set of configuration parameters identical to the configuration parameters that are associated with the service instance and that impacts the requirement. 
 
 
     
     
       6. The method of  claim 5 , wherein the step of applying test suite reduction rules further comprises reducing the applicability matrix by:
 removing any service instance with no applicable test cases, and which realizes environment agnostic requirements; 
 removing any service instance if the service instance realizes an environment dependent requirement, the service instance has no applicable test cases and the service instance shares configuration parameters with another service instance that realizes a composite requirement; and 
 setting back applicability links if the service instance realizes an environment dependent requirement but the service instance has applicable test cases and does not share configuration parameters with another service instance that realizes a composite requirement. 
 
     
     
       7. The method of  claim 1 , wherein the step of applying test suite reduction rules further comprises reducing the applicability matrix by:
 removing any service instance with no applicable test cases, and which realizes environment agnostic requirements; 
 removing any service instance if the service instance realizes an environment dependent requirement, the service instance has no applicable test cases and the service instance shares configuration parameters with another service instance that realizes a composite requirement; and 
 setting back applicability links if the service instance realizes an environment dependent requirement but the service instance has applicable test cases and does not share configuration parameters with another service instance that realizes a composite requirement. 
 
     
     
       8. A system for validating that a configuration of a cloud system meets requirements, using a reduced test suite selected from a test suite comprising processing circuits and a memory, the memory containing instructions executable by the processing circuits whereby the system is operative to perform operations comprising:
 classifying, using the memory and the processing circuits, the requirements and service instances realizing the requirements composing the cloud system; 
 applying, using the memory and the processing circuits, test suite reduction rules to the test suite, using the classified requirements and service instances, to obtain the reduced test suite; 
 applying, using the memory and the processing circuits, the reduced test suite to the cloud system configured with the configuration, thereby validating that the configuration of the cloud system meets the requirements; 
 removing an applicability link between the service instance and a test case which realizes a requirement if the requirement is directly or indirectly impacted, the requirement is environment dependent, and there is an entry in a history consisting of a test case, a requirement, and a set of configuration parameters identical to the set of configuration parameters that are associated with the service instance and that impacts the requirement; and 
 causing signaling between hardware nodes and radio units via the memory and the processing circuitry, wherein the step of classifying the service instances further comprises classifying the service instances among: a service instance directly impacted by a change, a service instance indirectly impacted by the change and a service instance not impacted by the change, wherein classifying the service instance is done using an applicability matrix which maps test cases to service instances to which the test cases are applicable and using a requirement-service matrix which maps every requirement to the service instance realizing the requirement. 
 
     
     
       9. The system of  claim 7 , further operative to classify the requirements among:
 environment agnostic requirements, environment dependent requirements and composite requirements, wherein classifying the requirements further comprises classifying configuration parameters as environment agnostic or environment dependent configurations parameters and mapping every requirement that is realized by the cloud system to a configuration parameter to which it is related. 
 
     
     
       10. The system of  claim 9 , further operative to classify the requirements among: directly impacted requirements, indirectly impacted requirements and unimpacted requirements based on the classification of the service instances. 
     
     
       11. The system of  claim 8 , further operative to classify the service instances among: a service instance directly impacted by a change, a service instance indirectly impacted by the change and a service instance not impacted by the change, wherein classifying the service instance is done using an applicability matrix which maps test cases to service instances to which the test cases are applicable and using a requirement-service matrix which maps every requirement to the service instance realizing the requirement. 
     
     
       12. The system of  claim 11 , further operative to reduce the applicability matrix by:
 removing all the service instances realizing the requirement which are not impacted by the change; and 
 removing an applicability link between the service instance and a test case which realizes a requirement if:
 the requirement is directly or indirectly impacted, the requirement is environment dependent, and there is an entry in a history consisting of a test case, a requirement, and a set of configuration parameters identical to the set of configuration parameters that are associated with the service instance and that impacts the requirement; or 
 the requirement is directly impacted, the requirement is environment agnostic, and there is an entry in the history consisting of test case, a requirement, and a set of configuration parameters identical to the configuration parameters that are associated with the service instance and that impacts the requirement. 
 
 
     
     
       13. The system of  claim 12 , further operative to reduce the applicability matrix by:
 removing any service instance with no applicable test cases, and which realizes environment agnostic requirements; 
 removing any service instance if the service instance realizes an environment dependent requirement, if the service instance has no applicable test cases and the service instance shares configuration parameters with another service instance that realizes a composite requirement; and 
 setting back applicability links if the service instance realizes an environment dependent requirement but the service instance has applicable test cases and does not share configuration parameters with another service instance that realizes a composite requirement. 
 
     
     
       14. The system of  claim 11 , further operative to reduce the applicability matrix by:
 removing any service instance with no applicable test cases, and which realizes environment agnostic requirements; 
 removing any service instance if the service instance realizes an environment dependent requirement, if the service instance has no applicable test cases and the service instance shares configuration parameters with another service instance that realizes a composite requirement; and 
 setting back applicability links if the service instance realizes an environment dependent requirement but the service instance has applicable test cases and does not share configuration parameters with another service instance that realizes a composite requirement. 
 
     
     
       15. The system of  claim 8 , further operative to classify the requirements among: directly impacted requirements, indirectly impacted requirements and unimpacted requirements based on the classification of the service instances. 
     
     
       16. A non-transitory computer readable media having stored thereon instructions for validating that a configuration of a cloud system meets requirements, using a reduced test suite selected from a test suite, the instructions comprising:
 classifying the requirements and service instances realizing the requirements composing the cloud system; 
 applying test suite reduction rules to the test suite, using the classified requirements and service instances, to obtain the reduced test suite; and 
 applying the reduced test suite to the cloud system configured with the configuration, thereby validating that the configuration of the cloud system meets the requirements and causing signaling between hardware nodes and radio units via a memory and a processing circuitry; 
 removing an applicability link between the service instance and a test case which realizes a requirement if the requirement is directly or indirectly impacted, the requirement is environment dependent, and there is an entry in a history consisting of a test case, a requirement, and a set of configuration parameters identical to the set of configuration parameters that are associated with the service instance and that impacts the requirement; and 
 causing signaling between hardware nodes and radio units via the memory and the processing circuitry, wherein the step of classifying the service instances further comprises classifying the service instances among: a service instance directly impacted by a change, a service instance indirectly impacted by the change and a service instance not impacted by the change, wherein classifying the service instance is done using an applicability matrix which maps test cases to service instances to which the test cases are applicable and using a requirement-service matrix which maps every requirement to the service instance realizing the requirement.