Image processing device, and image processing method,

Abstract

It is possible to generate a panoramic moving image with a high combination performance while suppressing a calculation amount. The positional-shift-amount acquisition unit acquires positional shift amounts of a predetermined number of frames from a first moving image and a second moving image captured by cameras, each of the first and second moving images including a plurality of frames. The frame selection unit selects the predetermined number of frames from the plurality of frames. For example, the frame selection unit selects the predetermined number of frames on the basis of sensor output and/or image processing results. An image combination unit combines the first moving image and the second moving image on the basis of the positional shift amounts of the predetermined number of frames to obtain a panoramic image.

1 . An image processing device, comprising:
 circuitry configured to:   select a number of frames from a first moving image and a second moving image, wherein each of the first moving image and the second moving image has a plurality of frames captured by a camera; and   acquire positional shift amounts of the number of frames from the first moving image and the second moving image.   
     
     
         2 . The image processing device according to  claim 1 , wherein
 the circuitry is further configured to stabilize the positional shift amounts based on an average of the positional shift amounts of the number of frames.   
     
     
         3 . The image processing device according to  claim 1 , wherein:
 the circuitry is further configured to stabilize the positional shift amounts based on an average of positional shift amounts of frames of the plurality of frames, and   a value of each of the positional shift amounts corresponding to each of the frames is in a specific range.   
     
     
         4 . The image processing device according to  claim 1 , wherein
 the circuitry is further configured to:
 classify the positional shift amounts into a plurality of classes; and 
 stabilize the positional shift amounts based on an average of positional shift amounts belonging to a class of the plurality of classes. 
   
     
     
         5 . The image processing device according to  claim 1 , wherein
 the circuitry is further configured to select the number of frames in a specific order.   
     
     
         6 . The image processing device according to  claim 2 , wherein
 the circuitry is further configured to combine the first moving image and the second moving image based on the stabilized positional shift amounts to obtain a panoramic moving image.   
     
     
         7 . An image processing method, comprising:
 in an image processing device:
 selecting a number of frames from a first moving image and a second moving image, wherein each of the first moving image and the second moving image has a plurality of frames captured by a camera; and 
 acquiring positional shift amounts of the number of frames from the first moving image and the second moving image. 
   
     
     
         8 . The image processing method according to  claim 7 , further comprising
 stabilizing the positional shift amounts based on an average of the positional shift amounts of the number of frames.   
     
     
         9 . The image processing method according to  claim 7 , further comprising
 stabilizing the positional shift amounts based on an average of positional shift amounts of frames of the plurality of frames,   wherein a value of each of the positional shift amounts corresponding to each of the frames is in a specific range.   
     
     
         10 . The image processing method according to  claim 7 , further comprising:
 classifying the positional shift amounts into a plurality of classes; and   stabilizing the positional shift amounts based on an average of positional shift amounts belonging to a class of the plurality of classes.   
     
     
         11 . The image processing method according to  claim 7 , wherein
 the selection of the number of frames is in a specific order.   
     
     
         12 . The image processing method according to  claim 8 , further comprising
 combining the first moving image and the second moving image based on the stabilized positional shift amounts to obtain a panoramic moving image.   
     
     
         13 . A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
 selecting a number of frames from a first moving image and a second moving image, wherein each of the first moving image and the second moving image has a plurality of frames captured by a camera; and   acquiring positional shift amounts of the number of frames from the first moving image and the second moving image.   
     
     
         14 . The non-transitory computer-readable medium according to  claim 13 , wherein the operations further comprising
 stabilizing the positional shift amounts based on an average of the positional shift amounts of the number of frames.   
     
     
         15 . The non-transitory computer-readable medium according to  claim 13 , wherein the operations further comprising
 stabilizing the positional shift amounts based on an average of positional shift amounts of frames of the plurality of frames,   wherein a value of each of the positional shift amounts corresponding to each of the frames is in a specific range.   
     
     
         16 . The non-transitory computer-readable medium according to  claim 13 , wherein the operations further comprising:
 classifying the positional shift amounts into a plurality of classes; and   stabilizing the positional shift amounts based on an average of positional shift amounts belonging to a class of the plurality of classes.   
     
     
         17 . The non-transitory computer-readable medium according to  claim 13 , wherein the selection of the number of frames is in a specific order. 
     
     
         18 . The non-transitory computer-readable medium according to  claim 14 , wherein the operations further comprising
 combining the first moving image and the second moving image based on the stabilized positional shift amounts to obtain a panoramic moving image.