Remote operating system

Abstract

Provided is a remote operating system which enables to operate a device by a remote operating device in a simple and reliable manner even if the device to be operated is not equipped with a communication function, or if displayed contents on a monitor screen of the device to be operated are not recognized by the remote operating device. A remote operating system (100) includes: a screen acquisition unit (121); an image determination unit (122); a state providing unit (123); an operation reception unit (131); an operating signal output unit (132); a correct or incorrect operation determination unit (133); and a state database DB. The remote operating system (100) further includes a capture device (141) for capturing an image of a monitor X1 of a device X of interest, and a control interface (142) connected to a keyboard X2 of the object X to be controlled in a superimposed manner.

1 . A remote operating system remotely operating a device to be operated by a remote operating device based on a state of a monitor screen of the device to be operated, the remote operating system comprising:
 a computing device;   a capture device configured to capture the monitor screen of the device to be operated; and   a control interface connected between the remote operating system and a human interface of the device to be operated in a superimposed manner,   wherein the remote operating system, the device to be operated, and the remote operating device are all separate from each other and, among the remote operating system, the device to be operated, and the remote operating device, only the remote operating system and the remote operating device are in communication with each other via a network,   wherein the computing device comprises a processor and memory storing programs that, when executed by the processor, configure the processor to perform the functions comprising:   acquiring the monitor screen captured by the capture device as an image;   determining a state of the image from the image acquired by the capture device;   providing the remote operating device with the state determined;   receiving an operation communicated to the computing device from the remote operating device; and   converting the operation received from the remote operating device into an operating signal for the device to be operated as an emulation signal for the human interface, and outputting the operating signal to the device to be operated via the control interface,   wherein the determining further comprises determining from the image acquired whether the state of the image is in an image state that is operable by the device to be operated based on the operation communicated from the remote operating device,   in a case where the state of the image is the image state that is operable by the device to be operated, the providing further generates an operation input screen corresponding to the operable image state and provides the operation input screen to the remote operating device, and   wherein the determining further determines whether the state of the image is in the image state that is operable by the device to be operated from the image acquired by recognizing characters displayed on the image acquired and determining a state of the characters.   
     
     
         2 . (canceled) 
     
     
         3 . The remote operating system according to  claim 1 , wherein the processor of the computing device is further configured to perform the function of:
 determining whether operation of the device to be operated is correct or incorrect based on the state of the image acquired after outputting the operating signal to the device to be operated.   
     
     
         4 . A remote operating system remotely operating a device to be operated by a remote operating device based on a state of a monitor screen of the device to be operated, the remote operating system comprising:
 a computing device;   a capture device configured to capture the monitor screen of the device to be operated; and   a control interface connected between the remote operating system and a human interface of the device to be operated in a superimposed manner,   wherein the remote operating system, the device to be operated, and the remote operating device are all separate from each other and, among the remote operating system, the device to be operated, and the remote operating device, only the remote operating system and the remote operating device are in communication with each other via a network,   wherein the computing device comprises a processor and memory storing programs that when executed by the processor, configure the processor to perform the functions comprising:   acquiring the monitor screen captured by the capture device as an image;   recognizing characters displayed on the image acquired;   determining a state of the characters.   determining whether a state of the image acquired by the capture device is in an image state that is operable by the device to be operated based on the state of the characters determined;   generating an operation input screen corresponding to the operable image state and providing the operation input screen to the remote operating device, in a case where the state of the image is the image state that is operable by the device to be operated;   receiving an operation communicated to the computing device from the remote operating device; and   converting the operation received from the remote operating device into an operating signal for the device to be operated as an emulation signal for the human interface, and outputting the operating signal to the device to be operated via the control interface.   
     
     
         5 . The remote operating system according to  claim 4 , wherein the processor of the computing device is further configured to perform the function of:
 determining whether operation of the device to be operated is correct or incorrect based on the state of the image acquired after outputting the operating signal to the device to be operated.