Apparatus, systems, and methods for removing shading effect from image

Abstract

The disclosed subject matter includes an apparatus configured to remove a shading effect from an image. The apparatus can include one or more interfaces configured to provide communication with an imaging module that is configured to capture the image, and a processor, in communication with the one or more interfaces, configured to run a module stored in memory. The module is configured to receive the image captured by the imaging module under a first lighting spectrum, receive a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum, determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum, and operate the correction mesh on the image to remove the shading effect from the image.

I claim: 
     
       1. An apparatus configured to remove a shading effect from an image, the apparatus comprising:
 one or more interfaces configured to provide communication with an imaging module that is configured to capture the image; and 
 a processor, in communication with the one or more interfaces, configured to run a module stored in memory that is configured to:
 receive the image captured by the imaging module under a first lighting spectrum; 
 receive a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum; 
 determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum; and 
 operate the correction mesh on the image to remove the shading effect from the image. 
 
 
     
     
       2. The apparatus of  claim 1 , wherein the module is further configured to determine that the image was captured under the first lighting spectrum using an automated white balance technique. 
     
     
       3. The apparatus of  claim 2 , wherein the module is configured to:
 determine, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to a linear combination of two or more lighting spectra, 
 receive prediction functions associated with the two or more lighting spectra, 
 combine the prediction functions to generate a final prediction function, and 
 apply the final prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image. 
 
     
     
       4. The apparatus of  claim 2 , wherein the module is further configured to determine the correction mesh for the image based on the first lighting spectrum of the image. 
     
     
       5. The apparatus of  claim 2 , wherein the module is configured to:
 determine, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to one of a predetermined set of lighting spectra, 
 receive a prediction function associated with the one of the predetermined set of lighting spectra, and 
 apply the prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image. 
 
     
     
       6. The apparatus of  claim 5 , wherein the prediction function comprises a linear function. 
     
     
       7. The apparatus of  claim 5 , wherein the prediction function is based on characteristics of image sensors having an identical image sensor type as an image sensor in the imaging module. 
     
     
       8. The apparatus of  claim 5 , wherein the prediction function is associated only with the portion of the per-unit correction mesh. 
     
     
       9. The apparatus of  claim 1 , wherein the apparatus is a part of a camera module in a mobile device. 
     
     
       10. A method for removing a shading effect on an image, the method comprising:
 receiving, at a correction module of a computing system, the image captured under a first lighting spectrum from an imaging module over an interface of the computing system; 
 receiving, at the correction module, a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum; 
 determining, at the correction module, a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum; and 
 operating, at the correction module, the correction mesh on the image to remove the shading effect from the image. 
 
     
     
       11. The method of  claim 10 , further comprising determining that the image was captured under the first lighting spectrum using an automated white balance technique. 
     
     
       12. The method of  claim 11 , further comprising determining the correction mesh for the image based on the first lighting spectrum of the image. 
     
     
       13. The method of  claim 11 , further comprising:
 determining, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to one of a predetermined set of lighting spectra, 
 receiving a prediction function associated with the one of the predetermined set of lighting spectra, and 
 applying the prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image. 
 
     
     
       14. The method of  claim 13 , wherein the prediction function is based on characteristics of image sensors having an identical image sensor type as an image sensor in the imaging module. 
     
     
       15. The method of  claim 11 , further comprising:
 determining, using the automated white balance technique, that the first lighting spectrum of the image is substantially similar to a linear combination of two or more lighting spectra, 
 receiving prediction functions associated with the two or more lighting spectra, 
 combining the prediction functions to generate a final prediction function, and 
 applying the final prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image. 
 
     
     
       16. A non-transitory computer readable medium having executable instructions associated with a correction module, operable to cause a data processing apparatus to:
 receive an image captured under a first lighting spectrum from an imaging module in communication with the data processing apparatus; 
 retrieve, from a memory device, a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum; 
 determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum; and 
 operate the correction mesh on the image to remove a shading effect from the image. 
 
     
     
       17. The non-transitory computer readable medium of  claim 16 , further comprising executable instructions operable to cause the data processing apparatus to determine that the image was captured under the first lighting spectrum using an automated white balance technique. 
     
     
       18. The non-transitory computer readable medium of  claim 17 , further comprising executable instructions operable to cause the data processing apparatus to determine the correction mesh for the image based on the first lighting spectrum of the image. 
     
     
       19. The non-transitory computer readable medium of  claim 17 , further comprising executable instructions operable to cause the data processing apparatus to:
 receive a prediction function associated with one of a predetermined set of lighting spectra, and 
 apply the prediction function to at least a portion of the per-unit correction mesh to determine the correction mesh for the image. 
 
     
     
       20. The non-transitory computer readable medium of  claim 17 , wherein the prediction function is based on characteristics of image sensors having an identical image sensor type as an image sensor in the imaging module.