System and methods for calibration of an array camera

Abstract

Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the capturing of an image of a test pattern with the array camera such that each imaging component in the array camera captures an image of the test pattern. The image of the test pattern captured by a reference imaging component is then used to derive calibration information for the reference component. A corrected image of the test pattern for the reference component is then generated from the calibration information and the image of the test pattern captured by the reference imaging component. The corrected image is then used with the images captured by each of the associate imaging components associated with the reference component to generate calibration information for the associate imaging components.

What is claimed: 
     
       1. An array camera system, comprising:
 an array of cameras comprising a plurality of imaging components that capture images of a scene from different viewpoints including:
 a reference imaging component having a reference viewpoint; and 
 an associate imaging component; 
 
 a processor; and 
 memory in communication with the processor, said memory storing:
 a software application comprising machine readable instructions; 
 calibration information for the reference imaging component comprising scene independent geometric corrections for image data captured by the reference imaging component to account for distortions related to the mechanical construction of the imaging component and produce a corrected reference image; 
 calibration information for the associate imaging component comprising scene independent geometric corrections for image data captured by the associate imaging component that correct the location of pixels in an image captured by the associate imaging component to locations of corresponding pixel locations in the corrected reference image, where corresponding pixel locations image the same point in a scene in the absence of disparity due to parallax; 
 
 wherein execution of the software application by the processor directs the processor to:
 capture image data using the plurality of imaging components in the array of cameras including:
 a reference image captured by the reference imaging component; and 
 an associate image captured by the associate imaging component; 
 
 apply corrections to the locations of pixels of the reference image using the calibration information for the reference imaging component; 
 apply corrections to the locations of pixels of the associate image using the calibration information for the reference imaging component; 
 generate a depth map by measuring disparity due to parallax between the corrected pixels in the reference image and the corrected pixels in the associate image; and 
 synthesize an image using the depth map and at least some of the pixels from the captured image data. 
 
 
     
     
       2. The array camera system of  claim 1 , wherein the calibration information for the reference imaging component includes characterization information and correction parameters. 
     
     
       3. The array camera system of  claim 2 , wherein the characterization information includes uniformity characteristics. 
     
     
       4. The array camera system of  claim 1 , wherein the calibration information for the reference imaging component includes compensation parameters for low frequency aberrations. 
     
     
       5. The array camera system of  claim 4 , wherein the compensation parameters include X and Y translations. 
     
     
       6. The array camera system of  claim 4 , wherein the compensation parameters include a 3rd-order radial translation. 
     
     
       7. The array camera system of  claim 4 , wherein the compensation parameters include a 5th-order radial translation. 
     
     
       8. The array camera system of  claim 1 , wherein execution of the image processing application by the processor further directs the processor to dynamically refocus an image to blur the synthesized image to make portions of a scene appear out of focus. 
     
     
       9. The array camera system of  claim 1 , wherein execution of the image processing application by the processor further directs the processor to generate a stereo pair of images using the depth map and the captured image data. 
     
     
       10. The array camera system of  claim 9 , wherein the array camera system further comprises a 3D display. 
     
     
       11. The array camera system of  claim 1 , wherein the depth map is utilized by the processor to synthesize an image from one or more virtual viewpoints. 
     
     
       12. The array camera system of  claim 11 , wherein a rendering device simulates motion parallax and dolly zoom. 
     
     
       13. The array camera system of  claim 1 , wherein the synthesized image is a super-resolution image. 
     
     
       14. The array camera system of  claim 1 , wherein the calibration information for the reference imaging component further includes colorimetric corrections for image data captured by the reference imaging component. 
     
     
       15. The array camera system of  claim 1 , wherein the calibration information for the associate imaging component further includes colorimetric corrections for image data captured by the associate imaging component. 
     
     
       16. The array camera system of  claim 1 , wherein the calibration information for the reference imaging component further includes photometric corrections for image data captured by the reference imaging component. 
     
     
       17. The array camera system of  claim 1 , wherein the calibration information for the associate imaging component further includes photometric corrections for image data captured by the associate imaging component. 
     
     
       18. The array camera system of  claim 1 , wherein the scene independent geometric corrections for image data captured by the associate imaging component are represented by a grid that provides a geometric correction prescription for pixels of the associate imaging component.