US8711452B2ExpiredUtilityA1

Processing color and panchromatic pixels

89
Assignee: HAMILTON JR JOHN FPriority: Jul 28, 2005Filed: Sep 14, 2012Granted: Apr 29, 2014
Est. expiryJul 28, 2025(expired)· nominal 20-yr term from priority
H04N 23/84H04N 25/134H04N 25/135H04N 25/133
89
PatentIndex Score
9
Cited by
412
References
18
Claims

Abstract

A method for forming a final digital color image includes capturing an image using an image sensor having panchromatic pixels and color pixels corresponding to at least two color photoresponses; providing from the captured image a digital panchromatic image and an intermediate digital color image; and using the digital panchromatic image and the intermediate digital color image to provide the final digital color image.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A method for forming a digital color image comprising:
 capturing an image using a solid state image sensor having a pixel array that includes both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating unit is 
 
       
         
           
             
               
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
               
               
                 
                   B 
                 
                 
                   B 
                 
                 
                   A 
                 
                 
                   A 
                 
               
               
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
               
               
                 
                   C 
                 
                 
                   C 
                 
                 
                   B 
                 
                 
                   B 
                 
               
             
           
         
         wherein P represents panchromatic pixels, A represents color pixels having a first photoresponse, B represents color pixels having a second photoresponse, and C represents color pixels having a third photoresponse; 
         grouping signals from all of the color pixels in each cell into one or more group signals to increase color photosensitivity, wherein all pixels whose signals are grouped into a group signal have the same color photoresponse; 
         combining the group signals to form a low-resolution digital color image having a first resolution based on the resolution of the cells; 
         using second signals from the individual panchromatic pixels to provide a high-resolution digital panchromatic image having a second resolution based on the resolution of the pixels in the image sensor; and 
         combining the high-resolution digital panchromatic image and the low-resolution digital color image to provide a high-resolution digital color image. 
       
     
     
       2. The method of  claim 1  wherein A, B, and C are each respectively red, green, and blue. 
     
     
       3. The method of  claim 1  wherein A, B, and C are each respectively cyan, yellow, and magenta. 
     
     
       4. A method for processing a color image captured by an image sensor to permit the effective reproduction of a color image captured under low lighting conditions, comprising:
 (a) using a solid state image sensor to capture an image, the image sensor having a pixel array including both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses, and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating unit is: 
 
       
         
           
             
               
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
               
               
                 
                   B 
                 
                 
                   B 
                 
                 
                   A 
                 
                 
                   A 
                 
               
               
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
                 
                   P 
                 
               
               
                 
                   C 
                 
                 
                   C 
                 
                 
                   B 
                 
                 
                   B 
                 
               
             
           
         
         wherein P represents panchromatic pixels, A represents color pixels having a first photoresponse, B represents color pixels having a second photoresponse, and C represents color pixels having a third photoresponse; 
         (b) grouping signals from all of the color pixels within each cell into one or more group signals to increase color photosensitivity, wherein all pixels whose signals are grouped into a group signal have the same color photoresponse; 
         (c) combining the group signals to form a low-resolution digital color image having a first resolution based on the resolution of the cells; 
         (d) using second signals from the individual panchromatic pixels to provide a high-resolution digital panchromatic image having a second resolution based on the resolution of the pixels in the image sensor; and 
         (e) combining the low-resolution digital color image and the high-resolution digital panchromatic image to produce a high-resolution digital color image. 
       
     
     
       5. The method of  claim 4  wherein element (b) includes summing the first signals from the plurality of pixels having the same color photoresponse in each group. 
     
     
       6. The method of  claim 5  wherein element (e) includes:
 summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution; 
 using the low-resolution panchromatic image and the low-resolution partial color image to produce a color difference image; and 
 using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image. 
 
     
     
       7. The method of  claim 4  wherein element (e) includes:
 summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution; 
 using the low-resolution panchromatic image and the low-resolution color image to produce a color difference image; and 
 using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image. 
 
     
     
       8. The method of  claim 4  wherein A, B, and C are each respectively red, green, and blue. 
     
     
       9. The method of  claim 4  wherein A, B, and C are each respectively cyan, yellow, and magenta. 
     
     
       10. A method for forming a digital color image comprising:
 capturing an image using a solid state image sensor having a pixel array that includes both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating pattern is: 
 
       
         
           
             
               
                 
                   P 
                 
                 
                   B 
                 
                 
                   P 
                 
                 
                   A 
                 
               
               
                 
                   B 
                 
                 
                   P 
                 
                 
                   A 
                 
                 
                   P 
                 
               
               
                 
                   P 
                 
                 
                   C 
                 
                 
                   P 
                 
                 
                   B 
                 
               
               
                 
                   C 
                 
                 
                   P 
                 
                 
                   B 
                 
                 
                   P 
                 
               
             
           
         
         wherein P represents panchromatic pixels, A represents color pixels having a first photoresponse, B represents color pixels having a second photoresponse, and C represents color pixels having a third photoresponse; 
         grouping signals from all of the color pixels in each cell into one or more group signals to increase color photosensitivity, wherein all pixels whose signals are grouped into a group signal have the same color photoresponse; 
         combining the group signals to form a low-resolution digital color image having a first resolution based on the resolution of the cells; 
         using second signals from the individual panchromatic pixels to provide a high-resolution digital panchromatic image having a second resolution based on the resolution of the pixels in the image sensor; and 
         combining the high-resolution digital panchromatic image and the low-resolution digital color image to provide a high-resolution digital color image. 
       
     
     
       11. The method of  claim 10  wherein A, B, and C are each respectively red, green, and blue. 
     
     
       12. The method of  claim 10  wherein A, B, and C are each respectively cyan, yellow, and magenta. 
     
     
       13. A method for processing a color image captured by an image sensor to permit the effective reproduction of a color image captured under low lighting conditions, comprising:
 (a) using a solid state image sensor to capture an image, the image sensor having a pixel array including both panchromatic pixels and color pixels, wherein the color pixels correspond to at least two color photoresponses, and wherein the pixel array is made up of a plurality of tiled minimal repeating units, each minimal repeating unit including a plurality of cells, each cell including at least two panchromatic pixels and at least two pixels having the same color photoresponse, wherein the minimal repeating pattern is: 
 
       
         
           
             
               
                 
                   P 
                 
                 
                   B 
                 
                 
                   P 
                 
                 
                   A 
                 
               
               
                 
                   B 
                 
                 
                   P 
                 
                 
                   A 
                 
                 
                   P 
                 
               
               
                 
                   P 
                 
                 
                   C 
                 
                 
                   P 
                 
                 
                   B 
                 
               
               
                 
                   C 
                 
                 
                   P 
                 
                 
                   B 
                 
                 
                   P 
                 
               
             
           
         
         wherein P represents panchromatic pixels, A represents color pixels having a first photoresponse, B represents color pixels having a second photoresponse, and C represents color pixels having a third photoresponse; 
         (b) grouping signals from all of the color pixels within each cell into one or more group signals to increase color photosensitivity, wherein all pixels whose signals are grouped into a group signal have the same color photoresponse; 
         (c) combining the group signals to form a low-resolution digital color image having a first resolution based on the resolution of the cells; 
         (d) using second signals from the individual panchromatic pixels to provide a high-resolution digital panchromatic image having a second resolution based on the resolution of the pixels in the image sensor; and 
         (e) combining the low-resolution digital color image and the high-resolution digital panchromatic image to produce a high-resolution digital color image. 
       
     
     
       14. The method of  claim 13  wherein element (b) includes summing the first signals from the plurality of pixels having the same color photoresponse in each group. 
     
     
       15. The method of  claim 14  wherein element (e) includes:
 summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution; 
 using the low-resolution panchromatic image and the low-resolution partial color image to produce a color difference image; and 
 using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image. 
 
     
     
       16. The method of  claim 13  wherein element (e) includes:
 summing pixel values from the high-resolution panchromatic image to produce a low-resolution panchromatic image having the first resolution; 
 using the low-resolution panchromatic image and the low-resolution color image to produce a color difference image; and 
 using the color difference image and the high-resolution panchromatic image to produce a high-resolution color image. 
 
     
     
       17. The method of  claim 13  wherein A, B, and C are each respectively red, green, and blue. 
     
     
       18. The method of  claim 13  wherein A, B, and C are each respectively cyan, yellow, and magenta.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.