Systems and methods for presenting an augmented reality

Abstract

A first computing device in an industrial automation system may include an image sensor that captures a visual representation of a portion of a facility including a first industrial automation equipment as image data and a communication component that communicatively couples the first computing device to a second computing device via a communication network, in which the first computing device receives relevant information related to the first industrial automation equipment from the second computing device. The first computing may include a display component that displays a plurality of real objects that visually represent physical features in the portion of the facility based at least in part on the image data, in which the plurality of real objects include a first real object that visual represents physical features of the first industrial automation equipment; and that displays a first virtual object superimposed on at least a portion of the plurality of real objects based at least in part on the relevant information.

1 . A non-transitory, computer-readable medium storing instructions executable by at least one processor in a computing device, wherein the instructions are configured to cause the at least one processor to perform operations comprising:
 receiving image data representative of a facility from an image sensor of the computing device;   determining a location of the computing device within the facility;   receiving operational data from an industrial automation equipment in the facility based on the location;   determining that the industrial automation equipment is at least partially blocked from view of the image sensor;   identifying one or more real objects presented in the image data that obstruct a view of the industrial automation equipment;   modifying the one or more real objects to display one or more outlines of the one or more real objects in response to the computing device being within a threshold distance from the industrial automation equipment;   generating a virtual object representative of the industrial automation equipment based on the operational data; and   superimposing the virtual object on at least a portion of the one or more outlines within the image data.   
     
     
         2 . The computer-readable medium of  claim 1 , wherein the instructions that cause the at least one processor to determine the location of the computing device comprises receiving location data associated with the computing device from a location sensor that is part of the computing device. 
     
     
         3 . The computer-readable medium of  claim 1 , wherein the instructions that cause the at least one processor to perform the operations comprising determining one or more physical dimensions of the industrial automation equipment based on the operational data. 
     
     
         4 . The computer-readable medium of  claim 1 , wherein the instructions that cause the at least one processor to perform the operations comprising determining an orientation of the computing device in relation to the industrial automation equipment based on the location. 
     
     
         5 . The computer-readable medium of  claim 1 , wherein the the virtual object comprises a three-dimensional (3D) representation of the industrial automation equipment. 
     
     
         6 . The computer-readable medium of  claim 1 , wherein the virtual object comprises an illumination visual effect. 
     
     
         7 . The computer-readable medium of  claim 1 , wherein the virtual object comprises one or more visual indications representative of the operational data associated with the industrial automation equipment. 
     
     
         8 . The computer-readable medium of  claim 1 , wherein the instructions that cause the at least one processor to perform the operations comprises receiving one or more inputs via a display device presenting the image data. 
     
     
         9 . A non-transitory, computer-readable medium storing instructions executable by at least one processor in a computing device, wherein the instructions comprise instructions to cause the at least one processor to perform operations comprising:
 receiving image data representative of a facility from an image sensor of the computing device;   determining a location of the computing device within the facility;   receiving operational data from an industrial automation equipment in the facility based on the location;   determining that the industrial automation equipment is at least partially blocked from view of the image sensor;   identifying one or more real objects presented in the image data that obstruct a view of the industrial automation equipment;   modifying the one or more real objects to display one or more outlines of the one or more real objects in response to the computing device being within a threshold distance from the industrial automation equipment;   generating a first virtual object representative of the industrial automation equipment based on the operational data, wherein the first virtual object corresponds to a selectable graphic object; and   superimposing the first virtual object on at least a portion of the one or more outlines within the image data;   receiving from an input at the first virtual object via the image data presented on a display device;   generating a second virtual object representative of the operational data of the industrial automation equipment in response to receiving the input from the user; and   superimposing the second virtual object on the image data.   
     
     
         10 . The computer-readable medium of  claim 9 , wherein the input comprises a touch input. 
     
     
         11 . The computer-readable medium of  claim 9 , wherein the instructions that cause the at least one processor to perform the operations comprises displaying the one or more outlines using a visual effect. 
     
     
         12 . The computer-readable medium of  claim 9 , wherein the first virtual object comprises one or more virtual button objects configured to receive one or more inputs, and wherein each of the one or more virtual button objects is configured cause the at least one processor to present information related to one or more respective properties of the industrial automation equipment. 
     
     
         13 . The computer-readable medium of  claim 12 , wherein the instructions that cause the at least one processor to perform the operations comprising superimposing one or more graphics associated with the one or more respective properties in response to receiving the one or more inputs via the one or more virtual button objects. 
     
     
         14 . The computer-readable medium of  claim 9 , wherein the first virtual object comprises one or more virtual button objects configured to receive one or more inputs, and wherein each of the one or more virtual button objects is configured cause the at least one processor to cause the industrial automation equipment to perform one or more functions. 
     
     
         15 . The computer-readable medium of  claim 14 , wherein the one or more functions comprise updating software associate with the industrial operation equipment. 
     
     
         16 . A method, comprising:
 displaying, via a processor, image data representative of industrial automation equipment, wherein the image data is acquired via an image sensor of a computing device;   determining, via the processor, that the computing device is within a threshold distance of the industrial automation equipment;   receiving, via the processor, data associated with the industrial automation equipment from one or more databases, wherein the data is representative of one or more components that are part of the industrial automation equipment;   modifying, via the processor, the image data to present an outline of the industrial automation equipment;   generating, via the processor, one or more virtual objects that depict the one or more components of the industrial automation equipment within the outline of the industrial automation equipment; and   displaying, via the processor, the one or more virtual objects within the outline.   
     
     
         17 . The method of  claim 16 , wherein determining that the computing device is within the threshold distance of the industrial automation equipment comprises receiving location data associated with the computing device from a location sensor that is part of the computing device. 
     
     
         18 . The method of  claim 16 , wherein generating the one or more virtual objects comprises:
 generating one or more graphics based on the data; and   positioning the one or more graphics within the outline, wherein the one or more graphics are positioned based on one or more relative positions of the one or more components with respect to the industrial automation equipment.   
     
     
         19 . The method of  claim 16 , wherein the data comprises one or more identities associated with the one or more components, one or more temperatures associated with the one or more components, one or more speeds associated with the one or more components, one or more statuses associated with the one or more components, or a combination thereof. 
     
     
         20 . The method of  claim 19 , wherein the one or more virtual objects comprise one or more graphics representative of the data.