Image processing device and method for simultaneously transmitting a plurality of pieces of image data obtained from a plurality of camera modules

Abstract

Provided is a surveillance system including a communication module configured to receive a plurality of pieces of image data obtained by a plurality of camera modules, receive a multiple image data request from a client terminal, and transmit a multiple image data response including multiple image data to the client terminal; and a processer configured to generate the multiple image data by scaling the plurality of pieces of image data in response to the multiple image data request and combining a plurality of pieces of scaled image data, wherein the plurality of camera modules share one internet protocol (IP) address.

The invention claimed is: 
     
       1. An image processing device of a host device comprising:
 a communication module configured to 
 receive a plurality of pieces of image data obtained by a plurality of camera modules, wherein the plurality of camera modules constitute one network camera, 
 receive a multiple image data request from a client terminal, wherein the multiple image data request is a request for simultaneously receiving the plurality of pieces of image data by the one network camera, and 
 based on an operation error of the host device not being detected, transmit a multiple image data response comprising multiple image data to the client terminal; and 
 a processer configured to: 
 based on the operation error of the host device not being detected: 
 generate the multiple image data by scaling the plurality of pieces of image data in response to the multiple image data request and combining a plurality of pieces of scaled image data; 
 based on the operation error of the host device being detected: 
 select one camera module as a master camera module from among the plurality of camera modules; 
 enable the master camera module to perform a function of the communication module or a function of the processor in response to a network service provision request being received by the master camera module from the communication module; and 
 reboot the host device and provide a path to access the network camera after the network service provision request is transmitted to the master camera module, 
 wherein the plurality of camera modules share one internet protocol (IP) address. 
 
     
     
       2. The image processing device of  claim 1 , wherein the communication module is further configured to:
 receive the plurality of pieces of image data from the plurality of camera modules that are mounted in the one network camera and face in a plurality of different directions; 
 receive, from the client terminal, the multiple image data request that requests the one network camera to simultaneously transmit the plurality of pieces of image data that are obtained by capturing scenes in the plurality of different directions; and 
 in response to the multiple image data request, transmit the multiple image data comprising the plurality of pieces of image data, to the client terminal. 
 
     
     
       3. The image processing device of  claim 1 , wherein the communication module receives the plurality of pieces of image data encoded by the plurality of camera modules from a network switch. 
     
     
       4. The image processing device of  claim 3 , wherein the processor comprises:
 a decoder configured to decode the plurality of pieces of image data; 
 a scaler configured to scale a plurality of pieces of decoded image data; 
 a multiplexer configured to generate the multiple image data by combining the plurality of pieces of scaled image data; and 
 an encoder configured to encode the multiple image data, 
 wherein the processor includes the multiple image data encoded by the encoder in the multiple image data response. 
 
     
     
       5. The image processing device of  claim 4 , wherein the scaler scales the plurality of pieces of decoded image data, such that a sum of resolutions of the plurality of pieces of scaled image data is lower than or equal to a resolution required by the client terminal. 
     
     
       6. The image processing device of  claim 1 , wherein when the processor detects the operation error of the host device,
 the communication module transmits the network service provision request to the master camera module, and 
 the master camera module performs the function of the communication module of transmitting the multiple image data response to the client terminal and the function of the processor of generating the multiple image data by scaling the plurality of pieces of image data, in response to the network service provision request being received from the communication module. 
 
     
     
       7. The image processing device of  claim 6 , wherein the processor selects a camera module of a predetermined highest priority from among the plurality of camera modules or a camera module with a least load from among the plurality of camera modules as the master camera module. 
     
     
       8. An image processing method performed by a host device comprising a processor and a communication module, the image processing method comprising:
 receiving, by the communication module, a multiple image data request from a client terminal; 
 receiving, by the communication module, a plurality of pieces of image data obtained by a plurality of camera modules that are mounted in one network camera and face in a plurality of different directions; 
 based on an operation error of the host device not being detected: 
 scaling, by the processor, the plurality of pieces of image data in response to the multiple image data request; and 
 in response to the multiple image data request, which requests the one network camera to simultaneously transmit the plurality of pieces of image data obtained by the plurality of camera modules, generating, by the processor, multiple image data by combining a plurality of pieces of scaled image data; and 
 transmitting, by the communication module, a multiple image data response comprising the multiple image data to the client terminal, 
 based on the operation error of the host device being detected: 
 selecting one camera module as a master camera module from among the plurality of camera modules; and 
 enabling the master camera module to perform a function of the communication module or a function of the processor in response to a network service provision request being received by the master camera module from the communication module; and 
 rebooting the host device and providing a path to access the network camera after the network service provision request is transmitted to the master camera module, 
 wherein the plurality of camera modules share one internet protocol (IP) address. 
 
     
     
       9. The method of  claim 8 , wherein the communication module receives, from a network switch, the plurality of pieces of image data encoded by the plurality of camera modules. 
     
     
       10. The method of  claim 9 , wherein the scaling of the plurality of pieces of image data comprises:
 decoding, by a decoder, the plurality of pieces of image data; and 
 scaling, by a scaler, a plurality of pieces of decoded image data, and 
 the generating of the multiple image data comprises: 
 generating, by a multiplexer, the multiple image data by combining the plurality of pieces of scaled image data; and 
 encoding, by an encoder, the multiple image data. 
 
     
     
       11. The method of  claim 10 , wherein, in the scaling of the plurality of pieces of decoded image data, the plurality of pieces of decoded image data are scaled by the scaler, such that a sum of resolutions of the plurality of pieces of scaled image data is lower than or equal to a resolution required by the client terminal. 
     
     
       12. The method of  claim 8 , wherein the communication module and the processor are included in the host device,
 the method further comprises selecting the one camera module from among the plurality of camera modules as the master camera module when the processor detects the operation error of the host device; and 
 transmitting, through the communication module, the network service provision request to the master camera module, and 
 the master camera module performs the function of the communication module and the function of the processor in response to the network service provision request. 
 
     
     
       13. The method of  claim 12 , wherein, in the selecting of the master camera module, the processor selects a camera module of a predetermined highest priority from among the plurality of camera modules or a camera module with a least load from among the plurality of camera modules as the master camera module. 
     
     
       14. The method of  claim 8 , wherein the receiving of the multiple image data request and the transmitting of the multiple image data response are performed by the host device,
 the receiving of the plurality of pieces of image data comprises receiving the plurality of pieces of image data as raw data prior to image processing, by a field programmable gate array (FPGA) device distinct from the host device, and 
 the scaling of the plurality of pieces of image data and the generating of the multiple image data are performed by the FPGA device based on the raw data.