Automated test runs in an integrated development environment system and method

Abstract

A method, computer program product, and computer system for editing code, by a computing device, via an integrated development environment. The code is determined to be syntactically valid. While editing the code, a subset of automated tests associated with the code is executed in response to determining that the code is syntactically valid. It is determined whether at least one automated test error is detected. The at least one automated test error is reported.

What is claimed is: 
     
       1. A computer-implemented method comprising:
 editing code, by a computing device, via an integrated development environment; 
 determining, by the computing device, whether the code is syntactically valid in response to the computing device determining a pause in receiving input for editing the code via the integrated development environment; 
 executing, while editing the code, a subset of automated tests associated with the code, wherein the subset of automated tests associated with the code is executed in the background during the editing of the code without executing an entire test suite of tests after the pause in receiving input for editing the code and in response to determining that the code is syntactically valid; 
 determining whether at least one automated test error is detected; 
 analyzing the automated tests to determine a runtime associated with each of the automated tests and to determine a portion of the code associated with each of the automated tests; 
 determining one or more automated tests to exclude from the subset of automated tests including one or more automated tests of the subset of automated tests with a runtime running longer than a threshold amount of time and one or more automated tests not associated with the code currently being edited; and 
 reporting the at least one automated test error, including highlighting at least a portion of the code associated with the at least one automated test error within the integrated development environment using a first visual style and highlighting at least a portion of the code associated with a syntax error using a different visual style. 
 
     
     
       2. The computer-implemented method of  claim 1 , wherein reporting the at least one automated test error within the integrated development environment includes displaying at least a portion of the code associated with the at least one automated test error within the integrated development environment. 
     
     
       3. The computer-implemented method of  claim 1 , wherein determining one or more automated tests to exclude from the subset of automated tests includes receiving a user preference of one or more automated tests to exclude from the subset of automated tests. 
     
     
       4. The computer-implemented method of  claim 1 , wherein each of the automated tests of the subset of automated tests is capable of running independently. 
     
     
       5. The computer-implemented method of  claim 1 , wherein the subset of automated tests is executed after every other pause in receiving input for editing the code. 
     
     
       6. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:
 editing code via an integrated development environment; 
 determining, by the processor, whether the code is syntactically valid in response to the processor determining a pause in receiving input for editing the code via the integrated development environment; 
 executing, while editing the code, a subset of automated tests associated with the code, wherein the subset of automated tests associated with the code is executed in the background during the editing of the code without executing an entire test suite of tests after the pause in receiving input for editing the code and in response to determining that the code is syntactically valid; 
 determining whether at least one automated test error is detected; 
 analyzing the automated tests to determine a runtime associated with each of the automated tests and to determine a portion of the code associated with each of the automated tests; 
 determining one or more automated tests to exclude from the subset of automated tests including one or more automated tests of the subset of automated tests with a runtime running longer than a threshold amount of time and one or more automated tests not associated with the code currently being edited; and 
 reporting the at least one automated test error, including highlighting at least a portion of the code associated with the at least one automated test error within the integrated development environment using a first visual style and highlighting at least a portion of the code associated with a syntax error using a different visual style. 
 
     
     
       7. The computer program product of  claim 6 , wherein reporting the at least one automated test error within the integrated development environment includes displaying at least a portion of the code associated with the at least one automated test error within the integrated development environment. 
     
     
       8. The computer program product of  claim 6 , wherein determining one or more automated tests to exclude from the subset of automated tests includes receiving a user preference of one or more automated tests to exclude from the subset of automated tests. 
     
     
       9. The computer program product of  claim 6 , wherein each of the automated tests of the subset of automated tests is capable of running independently. 
     
     
       10. The computer program product of  claim 6 , wherein the subset of automated tests is executed after every other pause in receiving input for editing the code. 
     
     
       11. A computing system including a processor and a memory configured to perform operations comprising:
 editing code via an integrated development environment; 
 determining, by the computing system, whether the code is syntactically valid in response to the computing system determining a pause in receiving input for editing the code via the integrated development environment; 
 executing, while editing the code, a subset of automated tests associated with the code, wherein the subset of automated tests associated with the code is executed in the background during the editing of the code without executing an entire test suite of tests after the pause in receiving input for editing the code and in response to determining that the code is syntactically valid; 
 determining whether at least one automated test error is detected; 
 analyzing the automated tests to determine a runtime associated with each of the automated tests and to determine a portion of the code associated with each of the automated tests; 
 determining one or more automated tests to exclude from the subset of automated tests including one or more automated tests of the subset of automated tests running longer than a threshold amount of time and one or more automated tests not associated with the code currently being edited; and 
 reporting the at least one automated test error, including highlighting at least a portion of the code associated with the at least one automated test error within the integrated development environment using a first visual style and highlighting at least a portion of the code associated with a syntax error using a different visual style. 
 
     
     
       12. The computing system of  claim 11 , wherein determining one or more automated tests to exclude from the subset of automated tests includes receiving a user preference of one or more automated tests to exclude from the subset of automated tests. 
     
     
       13. The computing system of  claim 11 , wherein each of the automated tests of the subset of automated tests is capable of running independently. 
     
     
       14. The computing system of  claim 11 , wherein the subset of automated tests is executed after every other pause in receiving input for editing the code.