Three-dimensional display apparatus, method, and program

Abstract

A subject is imaged at a predetermined time interval by a plurality of imaging units which obtains a plurality of images having a parallax of a subject viewed from different viewpoints by imaging the subject from different viewpoints. An evaluation value which includes at least one of a luminance and a high frequency component of the images obtained by the imaging units at the predetermined time interval is calculated. When the evaluation value has changed by an amount exceeding a predetermined threshold value, the distance information calculation and three-dimensional processing on the plurality of images and object are performed. Here, a relative position of the object with respect to the three-dimensional image in a three-dimensional space is changed based on the distance information such that overlapping of the object and the three-dimensional image on top of each other is prevented when the three-dimensional display is performed.

1. A three-dimensional display apparatus, comprising:
 a plurality of imaging units for obtaining a plurality of images having a parallax with respect to a subject viewed from different viewpoints by imaging the subject from different viewpoints; 
 a three-dimensional processing unit for performing three-dimensional processing for three-dimensional display on the plurality of images and performing the three-dimensional processing on an object to be displayed in the three-dimensionally displayed three-dimensional image in a superimposed manner; 
 a display unit for performing at least the three-dimensional display of the three-dimensional image; 
 a distance information calculation unit for calculating distance information of the three-dimensional image; 
 an imaging control unit for controlling the imaging units to image the subject at a predetermined time interval; 
 an evaluation value calculation unit for calculating an evaluation value which includes an evaluation value of at least one of a luminance and a high frequency component of the images obtained by the imaging units at the predetermined time interval; and 
 a control unit for controlling the distance information calculation unit and the three-dimensional processing unit to respectively perform the calculation of distance information and the three-dimensional processing on the plurality of images and the object when the evaluation value has changed by an amount exceeding a predetermined threshold value, 
 wherein the three-dimensional processing unit is a unit that changes a relative position of the object with respect to the three-dimensional image in a three-dimensional space based on the distance information such that overlapping of the object and the three-dimensional image on top of each other is prevented when the three-dimensional display is performed. 
 
     
     
       2. The three-dimensional display apparatus of  claim 1 , wherein:
 the distance information calculation unit is a unit that calculates the distance information for each pixel in a reference area where the object is displayed in a reference image serving as a reference of the plurality of images; and 
 the three-dimensional processing unit is a unit that changes a relative position of the object in a depth direction with respect to the three-dimensional image in the three-dimensional space based on the distance information in the reference area such that the object is three-dimensionally displayed at a position on the front side of the three-dimensional image. 
 
     
     
       3. The three-dimensional display apparatus of  claim 1 , wherein the distance information calculation unit is a unit that calculates a parallax of corresponding points between each of the plurality of images as the distance information. 
     
     
       4. The three-dimensional display apparatus of  claim 3 , wherein the distance information calculation unit is a unit that extracts a characteristic portion of the plurality of images and calculates the parallax of corresponding points from the characteristic portion. 
     
     
       5. The three-dimensional display apparatus of  claim 3 , wherein the distance information calculation unit is a unit that calculates the parallax of corresponding points based on an imaging condition at the time of obtaining the plurality of images. 
     
     
       6. The three-dimensional display apparatus of  claim 5 , wherein the distance information calculation unit is a unit that calculates a distance on the front side of a depth of field from the imaging condition, and calculates a maximum parallax of the corresponding points from the front side distance, a baseline length, and a focal length at the time of the imaging. 
     
     
       7. The three-dimensional display apparatus of  claim 3 , wherein the three-dimensional processing unit is a unit that performs the three-dimensional processing on the object so as to have a parallax greater than or equal to a maximum parallax of the parallaxes of the corresponding points calculated in a reference area. 
     
     
       8. The three-dimensional display apparatus of  claim 3 , wherein the three-dimensional processing unit is a unit that, when the three-dimensional processing is performed on the object so as to have a predetermined parallax, performs the three-dimensional processing on the plurality of images such that a maximum parallax of the parallaxes of the corresponding points calculated in a reference area becomes less than or equal to the predetermined parallax. 
     
     
       9. The three-dimensional display apparatus of  claim 1 , wherein the three-dimensional processing unit is a unit that changes a position of the object in a direction orthogonal to a depth direction in the three-dimensional space based on the distance information such that the object is displayed at a position where overlapping of the object and the three-dimensional image on top of each other is prevented. 
     
     
       10. The three-dimensional display apparatus of  claim 9 , wherein the distance calculation unit is a unit that calculates a parallax of corresponding points between each of the plurality of images as the distance information. 
     
     
       11. The three-dimensional display apparatus of  claim 10 , wherein the distance information calculation unit is a unit that extracts a characteristic portion of the plurality of images and calculates the parallax of corresponding points from the characteristic portion. 
     
     
       12. The three-dimensional display apparatus of  claim 1 , further comprising a control unit for controlling the distance information calculation unit and the three-dimensional processing unit to respectively perform the calculation of distance information and the three-dimensional processing on the plurality of images and the object at a predetermined time interval. 
     
     
       13. The three-dimensional display apparatus of  claim 1 , further comprising a control unit for controlling the distance information calculation unit and the three-dimensional processing unit to respectively perform the calculation of distance information and the three-dimensional processing on the plurality of images and the object when optical systems of the imaging units are driven. 
     
     
       14. A three-dimensional display method for use with a three-dimensional display apparatus which includes a plurality of imaging units for obtaining a plurality of images having a parallax with respect to a subject viewed from different viewpoints by imaging the subject from different viewpoints, a three-dimensional processing unit for performing three-dimensional processing for three-dimensional display on the plurality of images and performing the three-dimensional processing on an object to be displayed in the three-dimensionally displayed three-dimensional image in a superimposed manner, and a display unit for performing at least the three-dimensional display of the three-dimensional image, the method comprising the steps of:
 calculating distance information of the three-dimensional image; 
 changing a relative position of the object with respect to the three-dimensional image in a three-dimensional space based on the distance information such that overlapping of the object and the three-dimensional image on top of each other is prevented when the three-dimensional display is performed; 
 controlling the imaging units to image the subject at a predetermined time interval; 
 calculating an evaluation value which includes an evaluation value of at least one of a luminance and a high frequency component of the images obtained by the imaging units at the predetermined time interval; and 
 performing the calculation of distance information and the three-dimensional processing on the plurality of images and the object when the evaluation value has changed by an amount exceeding a predetermined threshold value. 
 
     
     
       15. A non-transitory computer readable recording medium storing a program for causing a computer to perform a three-dimensional display method for use with a three-dimensional display apparatus which includes a plurality of imaging units for obtaining a plurality of images having a parallax with respect to a subject viewed from different viewpoints by imaging the subject from different viewpoints, a three-dimensional processing unit for performing three-dimensional processing for three-dimensional display on the plurality of images and performing the three-dimensional processing on an object to be displayed in the three-dimensionally displayed three-dimensional image in a superimposed manner, and a display unit for performing at least the three-dimensional display of the three-dimensional image, the program causing the computer to perform the steps of:
 calculating distance information of the three-dimensional image; 
 changing a relative position of the object with respect to the three-dimensional image in a three-dimensional space based on the distance information such that overlapping of the object and the three-dimensional image on top of each other is prevented when the three-dimensional display is performed; 
 controlling the imaging units to image the subject at a predetermined time interval; 
 calculating an evaluation value which includes an evaluation value of at least one of a luminance and a high frequency component of the images obtained by the imaging units at the predetermined time interval; and 
 performing the calculation of distance information and the three-dimensional processing on the plurality of images and the object when the evaluation value has changed by an amount exceeding a predetermined threshold value. 
 
     
     
       16. A three-dimensional display apparatus, comprising:
 a plurality of imaging units for obtaining a plurality of images having a parallax with respect to a subject viewed from different viewpoints by imaging the subject from different viewpoints; 
 a three-dimensional processing unit for performing three-dimensional processing for three-dimensional display on the plurality of images and performing the three-dimensional processing on an object to be displayed in the three-dimensionally displayed three-dimensional image in a superimposed manner; 
 a display unit for performing at least the three-dimensional display of the three-dimensional image; 
 a distance information calculation unit for calculating distance information of the three-dimensional image; 
 an imaging control unit for controlling the imaging units to image the subject at a predetermined time interval; 
 an evaluation value calculation unit for calculating an evaluation value which includes an evaluation value of at least one of a luminance and a high frequency component of the images obtained by the imaging units at the predetermined time interval; and 
 a control unit for controlling the distance information calculation unit and the three-dimensional processing unit to respectively perform the calculation of distance information and the three-dimensional processing on the plurality of images and the object when the evaluation value has changed by an amount exceeding a predetermined threshold value, 
 wherein the three-dimensional processing unit is a unit that changes a relative position of the object with respect to the three-dimensional image in a three-dimensional space based on the distance information such that a positional relationship in which a portion or a whole of the object is hidden by the three-dimensional image is prevented when the three-dimensional display is performed.