Image sensing device and image sensing method thereof

Abstract

The present invention relates to an image sensing device comprising: an image sensing array and an image processing circuit. The image sensing array includes sub-array regions used to obtain sensing signals having different exposure period, wherein in a main frame period, the sensing signals include static sensing signals and dynamic sensing signals, the number of the static sensing signals and the dynamic sensing signals are any different positive integers, the static sensing signals are generated at a first frame rate for a first exposure period, and the dynamic sensing signal are generated at a second frame rate for a second exposure period. The image processing circuit analyzes the static sensing signals and the dynamic sensing signals, outputs sub-frames of the sensing signals having the same frame rate in the sub-array region, and fuses the sub-frames each having a different frame rate by a specific ratio to generate a main frame.

What is claimed is: 
     
         1 . An image sensing device, comprising:
 an image sensing array including a plurality of sub-array regions used to obtain a plurality of sensing signals having different exposure periods, wherein in a main frame period, the sensing signals include at least one static sensing signal and at least one dynamic sensing signal, the numbers of the at least one static sensing signal and the at least one dynamic sensing signal are any different positive integers, the at least one static sensing signal is generated at a first frame rate for a first exposure period, and the at least one dynamic sensing signal is generated at a second frame rate for a second exposure period; and   an image processing circuit coupled to the image sensing array for analyzing the at least one static sensing signal and the at least one dynamic sensing signal, outputting sub-frames of the sensing signals having the same frame rate in the sub-array region, and fusing the sub-frames each having a different frame rate by a specific ratio to generate a main frame.   
     
     
         2 . The image sensing device according to  claim 1 , wherein the first exposure period is greater than the second exposure period, and the second frame rate is greater than the first frame rate. 
     
     
         3 . The image sensing device according to  claim 1 , further comprising:
 a buffering circuit coupled to the image processing circuit,   wherein the sub-frames include at least one static sub-frames and at least one dynamic sub-frames, the buffering circuit is used to store the static sub-frames and the dynamic sub-frames.   
     
     
         4 . The image sensing device according to  claim 3 , wherein the image processing circuit performs a dynamic event detection processing on the sub-frames, which is used to determine whether an object in the sub-frames is a dynamic event, if not, the image processing circuit outputs the static sub-frames in the sub-frames, and if yes, the image processing circuit outputs the dynamic sub-frames in the sub-frames. 
     
     
         5 . The image sensing device according to  claim 4 , wherein the image processing circuit fuses the static sub-frames and the dynamic sub-frames into the main frame according to the results of the dynamic event detection processing. 
     
     
         6 . The image sensing device according to  claim 1 , wherein the image sensing array includes a plurality of sensing units, and the sub-array region includes a plurality of sub-array regions of the sensing units. 
     
     
         7 . The image sensing device according to  claim 6 , wherein each of the sensing units includes:
 a photodiode;   a transmission circuit coupled to the photodiode; and   a reset circuit coupled to the photodiode,   wherein the reset circuit is used to receive a reset signal, the transmission circuit is used to receive a readout signal, the reset circuit resets the charge in the photodiode according to the reset signal, and the transmission circuit converts the charge accumulated in the photodiode into the sensing signal based on the readout signal.   
     
     
         8 . The image sensing device according to  claim 7 , wherein the sub-array regions include a static sub-array region and a dynamic sub-array region, the static sub-array region is used to generate the at least one static sensing signal, and the dynamic sub-array region is used to generate the at least one dynamic sensing signal. 
     
     
         9 . The image sensing device according to  claim 8 , wherein the sensing units in one static sub-array region are arranged to form a Bayer pattern array, the sensing units in one dynamic sub-array region are arranged to form a Bayer pattern array, and the two Bayer pattern arrays are spaced adjacent to each other to form a row to form a two Bayer pattern array unit, and eight independent readout signal control lines are arranged in the two Bayer pattern array unit. 
     
     
         10 . The image sensing device according to  claim 8 , wherein the static sub-array region includes a plurality of static sensing units, the reset circuits of the static sensing units all receive a static reset signal, and the transmission circuits of the static sensing units all receive a static readout signal. 
     
     
         11 . The image sensing device according to  claim 10 , wherein the static reset signal includes a plurality of static reset timings, the static reset timings respectively reset the charge stored in the static sensing units, and the time difference between the static readout signal and the static reset timing received by each of the static sensing units is the first exposure period. 
     
     
         12 . The image sensing device according to  claim 8 , wherein the dynamic sub-array region includes a plurality of dynamic sensing units, the reset circuits of the dynamic sensing units all receive a dynamic reset signal, and the transmission circuits of the dynamic sensing units all receive a dynamic readout signal. 
     
     
         13 . The image sensing device according to  claim 12 , wherein the dynamic reset signal includes a plurality of dynamic reset timings, the dynamic reset timings respectively reset the charge stored in the dynamic sensing units, and the time difference between the dynamic readout signal and the dynamic reset timing received by each of the dynamic sensing units is the second exposure period. 
     
     
         14 . The image sensing device according to  claim 6 , wherein the image sensing array further includes a plurality of filters arranged on the sensing units, and the filters include at least one of visible light filters, infrared filters, and ultraviolet filters. 
     
     
         15 . The image sensing device according to  claim 7 , wherein the sensing units further include a control circuit coupled to the transmission circuit and the reset circuit, and the control circuit is used to generate the readout signal and the reset signal. 
     
     
         16 . The image sensing device according to  claim 15 , wherein the control circuit includes at least one static exposure control circuit and at least one dynamic exposure control circuit, the static exposure control circuit is used to generate at least one static reset signal and at least one static readout signal, and the dynamic exposure control circuit is used to generate at least one dynamic reset signal and at least one dynamic readout signal. 
     
     
         17 . The image sensing device according to  claim 16 , wherein the static exposure control circuit and the dynamic exposure control circuit respectively include a first address decoder and a second address decoder, which are used to respectively generate a first frame rate and a second frame rate, which are asynchronous. 
     
     
         18 . An image sensing method, comprising:
 during a main frame period, generating at least one static sensing signal and at least one dynamic sensing signal, the number of the at least one static sensing signal and the at least one dynamic sensing signal being any different positive integers, the at least one static sensing signal being generated at a first frame rate for a first exposure period, and the at least one dynamic sensing signal being generated at a second frame rate for a second exposure period; and   analyzing the at least one static sensing signal and the at least one dynamic sensing signal to output sub-frames of the at least one static sensing signal and the at least one dynamic sensing signal having the same frame rate, and performing fusion on the sub-frames each having a different frame rate to generate a main frame.   
     
     
         19 . The method according to  claim 18 , wherein the first exposure period is greater than the second exposure period, and the second frame rate is greater than the first frame rate. 
     
     
         20 . The method according to  claim 18 , wherein analyzing the at least one static sensing signal and the at least one dynamic sensing signal is to perform a dynamic event detection processing on the sub-frames, which is used to determine whether an object in the sub-frames is a dynamic event, if not, output the static sub-frames in the sub-frames, and if yes, output the dynamic sub-frames in the sub-frames. 
     
     
         21 . The method according to  claim 19 , wherein the static sub-frames and the dynamic sub-frames are fused by a respective specific ratio to generate the main frame according to the results of the dynamic event detection processing.