Tissue identification by an imaging system using color information

Abstract

In one embodiment, an imaging device determines color information for a portion of organic tissue from one or more captured color images of the tissue. The imaging device identifies one or more optical properties of the portion of tissue based on the determined color information. The imaging device adjusts fluorescence data captured via one or more fluorescence images of the portion of organic tissue. The imaging device provides the adjusted fluorescence data to an electronic display for display.

What is claimed is: 
     
       1. A method, comprising:
 determining, by an imaging device, color information for a portion of organic tissue from one or more captured color images of the organic tissue; 
 identifying, by the imaging device, one or more optical properties of the portion of organic tissue using the determined color information and a color lookup table that relates one or more colors with one or more respective types of organic tissues, wherein the determined color information is associated with the one or more optical properties in the color lookup table; 
 adjusting, by the imaging device and based on the one or more optical properties in the color lookup table, fluorescence data captured via one or more fluorescence images of the portion of organic tissue to correct one or more artifacts in the one or more fluorescence images; and 
 providing, by the imaging device, the adjusted fluorescence data to an electronic display for display. 
 
     
     
       2. The method as in  claim 1 , wherein the color information comprises captured red, green, and blue (RGB) color information from the one or more captured color images. 
     
     
       3. The method as in  claim 1 , wherein the fluorescence data indicates the presence of a fluorescent dye present in the portion of organic tissue. 
     
     
       4. The method as in  claim 1 , wherein the organic tissue is associated with the determined color information in the color lookup table. 
     
     
       5. The method as in  claim 1 , wherein the one or more optical properties of the portion of organic tissue comprise at least one of: scatter, absorption, or anisotropy. 
     
     
       6. The method as in  claim 1 , wherein the association of the determined color information with the one or more optical properties in the color lookup table is generated by a machine learning-based process. 
     
     
       7. The method as in  claim 1 , wherein the one or more color images and the one or more fluorescence images are captured while the portion of organic tissue is mounted by a microtome or cryotome. 
     
     
       8. The method as in  claim 1 , further comprising:
 capturing, by the imaging device, the one or more color images and the one or more fluorescence images of the portion of organic tissue. 
 
     
     
       9. The method as in  claim 1 , wherein the adjusted fluorescence data is provided to the electronic display in combination with a visible light image of the portion of organic tissue. 
     
     
       10. An imaging device comprising:
 an interface to provide display data to an electronic display; 
 a processor configured to execute one or more processes; and 
 a memory configured to store a process executable by the processor, the process when executed configured to:
 determine color information for a portion of organic tissue from one or more captured color images of the organic tissue; 
 identify one or more optical properties of the portion of organic tissue using the determined color information and a color lookup table that relates one or more colors with one or more respective types of organic tissues wherein the determined color information is associated with the one or more optical properties in the color lookup table; 
 adjust, based on the one or more optical properties in the color lookup table, fluorescence data captured via one or more fluorescence images of the portion of organic tissue to correct one or more artifacts in the one or more fluorescence images; and 
 provide the adjusted fluorescence data to an electronic display for display. 
 
 
     
     
       11. The imaging device as in  claim 10 , wherein the color information comprises captured red, green, and blue (RGB) color information from the one or more captured color images. 
     
     
       12. The imaging device as in  claim 10 , wherein the fluorescence data indicates the presence of a fluorescent dye present in the portion of organic tissue. 
     
     
       13. The imaging device as in  claim 10 , wherein the organic tissue is associated with the determined color information in the color lookup table. 
     
     
       14. The imaging device as in  claim 10 , wherein the one or more optical properties of the portion of organic tissue comprise at least one of: scatter, absorption, or anisotropy. 
     
     
       15. The imaging device as in  claim 10 , wherein the association of the determined color information with the one or more optical properties in the color lookup table is generated by a machine learning-based process. 
     
     
       16. The imaging device as in  claim 10 , wherein the one or more color images and the one or more fluorescence images are captured while the portion of organic tissue is mounted by a microtome or cryotome. 
     
     
       17. The imaging device as in  claim 10 , wherein the process when executed is further configured to:
 capture the one or more color images and the one or more fluorescence images of the portion of organic tissue. 
 
     
     
       18. The imaging device as in  claim 10 , wherein the adjusted fluorescence data is provided to the electronic display in combination with a visible light image of the portion of organic tissue. 
     
     
       19. A tangible, non-transitory, computer-readable medium storing program instructions that cause an imaging device to execute a process comprising:
 determining, by the imaging device, color information for a portion of organic tissue from one or more captured color images of the organic tissue; 
 identifying, by the imaging device, one or more optical properties of the portion of organic tissue using the determined color information and a color lookup table that relates one or more colors with one or more respective types of organic tissues, wherein the determined color information is associated with the one or more optical properties in the color lookup table; 
 adjusting, by the imaging device and based on the one or more optical properties in the color lookup table, fluorescence data captured via one or more fluorescence images of the portion of organic tissue to correct one or more artifacts in the one or more florescence images; and 
 providing, by the imaging device, the adjusted fluorescence data to an electronic display for display. 
 
     
     
       20. The computer-readable medium as in  claim 19 , wherein the color information comprises captured red, green, and blue (RGB) color information from the one or more captured color images.