Inspection workflow using ojbect recognition and other techniques

Abstract

Systems for guiding a user through a workflow routine can include an inspection tool, a user interface, memory, and a processor. The processor can provide instructions via the user interface to perform a workflow routine using the inspection tool and save acquiring inspection data to memory. Instructions can direct a user to which equipment to inspect and/or how to collect inspection data associated with one or more pieces of equipment. Systems can determine which equipment is available for inspection by the user, such as via image recognition or proximity detection, and instruct a user to acquire inspection data associated with such equipment. Workflow routine instructions can be provided to the user via various devices, such as an inspection tool, smartphone, or a tablet.

1 . A system comprising:
 an inspection tool configured to acquire inspection data;   a user interface;   memory; and   a processor in communication with the inspection tool, the user interface, and the memory, the processor being configured to:   provide instructions via the user interface to perform a workflow routine using the inspection tool, the workflow routine including at least collecting inspection data associated with a piece of equipment;   acquire the inspection data associated with the equipment; and   save the acquired inspection data to the memory.   
     
     
         2 . The system of  claim 1 , wherein the user interface, the memory, and the processor are included in the inspection tool. 
     
     
         3 . The system of  claim 1 , wherein the workflow routine comprises a list including a plurality of pieces of equipment for which to collect inspection data and one or more steps for collecting inspection data from each of the plurality of pieces of equipment. 
     
     
         4 . The system of  claim 3 , wherein the workflow routine includes a list of one or more devices necessary for completing the routine, the one or more devices including the inspection tool and the method and/or settings for operating at least one of the one or more devices. 
     
     
         5 . The system of  claim 1 , wherein the workflow routine is presented as an electronic document, and wherein the user interface comprises a computer, smartphone, or tablet. 
     
     
         6 . The system of  claim 1 , wherein the inspection tool comprises an imaging tool, and wherein the workflow routine comprises instructions for acquiring image data, including at least a viewing perspective or a reference image. 
     
     
         7 . The system of  claim 6 , wherein the processor is configured to:
 receive image data from the imaging tool; and   recognize an object within the received image data; and   wherein the workflow routine comprises instructions for collecting inspection data associated with the recognized object.   
     
     
         8 . The system of  claim 1 , further comprising a position sensor in communication with the processor, and wherein the processor is configured to provide instructions via the user interface to perform a workflow routine based on received position information from the position sensor. 
     
     
         9 . The system of  claim 8 , wherein the position information comprises proximity information representative of proximity between the user and a piece of equipment. 
     
     
         10 . The system of  claim 1 , wherein:
 providing instructions via the user interface to perform a workflow routine comprises displaying, on the user interface, a list of equipment that is part of the workflow routine and available for inspection; and   the processor is configured to:   receive a selection of a piece of equipment via the user interface; and   provide instructions, via the user interface, for collecting inspection data associated with the selected piece of equipment.   
     
     
         11 . The system of  claim 1 , wherein:
 providing instructions via the user interface to perform a workflow routine comprises displaying, on the user interface, a list of steps to perform during the workflow routine, and wherein steps that have been completed are shown in a distinguishing way from steps that have not been completed.   
     
     
         12 . The system of  claim 11 , wherein the processor is configured to determine automatically when one or more steps in the workflow routine are completed. 
     
     
         13 . The system of  claim 1 , wherein the processor is located remotely from the inspection tool and the user interface, and wherein the processor communicates with the inspection tool and the user interface via a network. 
     
     
         14 . A method of collecting data during a workflow routine, comprising:
 receiving information regarding an environment;   providing information regarding pieces of equipment in the environment;   identifying a piece of equipment for inspection;   acquiring inspection data representative of at least one parameter associated with the identified piece of equipment;   storing the inspection data.   
     
     
         15 . The method of  claim 14 , further comprising determining one or more pieces of equipment available for inspection; and
 wherein providing information regarding pieces of equipment in the environment comprises notifying a user of at least one piece of equipment currently available for inspection; and   identifying a piece of equipment for inspection comprises receiving a selection from a user designating the identified piece of equipment.   
     
     
         16 . The method of  claim 15 , further comprising the step of determining a first piece of equipment is within a predetermined proximity, and notifying the user that the first piece of equipment is available for inspection upon determining that the first piece of equipment is within the predetermined proximity. 
     
     
         17 . The method of  claim 15 , wherein determining one or more pieces of equipment available for inspection comprises recognizing one or more pieces of equipment within a field of view of an imaging tool. 
     
     
         18 . The method of  claim 15 , wherein determining one or more pieces available for inspection comprises determining one or more pieces of equipment for which inspection data has not yet been acquired. 
     
     
         19 . The method of  claim 15 , wherein notifying a user of at least one piece of equipment currently available for inspection comprises presenting a user with a list including equipment currently available for inspection. 
     
     
         20 . The method of  claim 19 , wherein the list including equipment currently available for inspection presents equipment for which inspection data has already been received in a visually distinguishing manner than equipment for which inspection data has not yet been received. 
     
     
         21 . The method of  claim 20 , wherein equipment for which inspection data has already been received are presented in the list in a different color than equipment for which inspection data has not yet been received. 
     
     
         22 . The method of  claim 19 , wherein receiving the selection of a piece of equipment comprises receiving a selection from the list including equipment currently available for inspection. 
     
     
         23 . The method of  claim 15 , further comprising outputting information related to the identified piece of equipment, the outputting information comprising:
 outputting directions to a location of the selected piece of equipment;   outputting one or more parameters associated with the selected piece of equipment;   outputting a workflow routine for acquiring the inspection data;   and/or presenting a reference image representative of the selected equipment.   
     
     
         24 . The method of  claim 14 , wherein the inspection data comprises acoustic image data, infrared image data, and/or visible light image data. 
     
     
         25 . The method of  claim 14 , wherein receiving information regarding the environment comprises determining one or more pieces of equipment in the environment. 
     
     
         26 . The method of  claim 25 , wherein determining one or more pieces of equipment in the environment comprises determining location information representative of a current location;
 receiving an input indicative of the environment;   and/or receiving proximity information representative of a proximity to one or more pieces of equipment.