Automatic association between physical and visual skin properties

Abstract

Techniques for automatic association between physical and visual skin properties are provided. A computer system receives a two-dimensional (2D) image and a three-dimensional (3D) image associated with a person and determines surface skin properties using the 2D image and physical skin properties using the 3D image. The computer system generates a skin disorder severity assessment using associations between the surface skin properties and the physical skin properties.

What is claimed is: 
     
       1. A computer-implemented method comprising:
 receiving, by a computer system, a two-dimensional (2D) image and a three-dimensional (3D) image associated with an area on a person; 
 determining, by the computer system, surface skin properties using the 2D image and physical skin properties using the 3D image; and 
 generating, by the computer system, a skin disorder severity assessment using associations between the surface skin properties and the physical skin properties, wherein the physical skin properties comprise an epidermal thickness value, a proliferation of keratinocytes value, an epidermal inflammation value, a blood vessel morphology value, and a keratinocyte morphology value. 
 
     
     
       2. The computer-implemented method of  claim 1 , wherein the 2D image represents a surface of skin of the person. 
     
     
       3. The computer-implemented method of  claim 1 , wherein the 3D image comprises a representation of inner layers of skin of the person. 
     
     
       4. The computer-implemented method of  claim 1 , wherein determining the surface skin properties using the 2D image comprises using a trained model to determine the surface skin properties from the 2D image. 
     
     
       5. The computer-implemented method of  claim 1 , wherein the surface skin properties comprise a redness severity score, a scale severity score, and an area severity score. 
     
     
       6. The computer-implemented method of  claim 1 , wherein determining the physical skin properties using the 3D image comprises using a trained model to determine the physical skin properties. 
     
     
       7. The computer-implemented method of  claim 1 , wherein:
 a trained model is used to determine the associations and to generate the skin disorder severity assessment using the associations between the surface skin properties and the physical skin properties; and 
 the skin disorder severity assessment comprises a selection from skin disorder severity labels. 
 
     
     
       8. A system comprising:
 a memory having computer readable instructions; and 
 one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:
 receiving a two-dimensional (2D) image and a three-dimensional (3D) image associated with an area of a person, the 2D and 3D images having been captured through use of a mobile device, wherein a device is coupled to the mobile device, the device comprising an infrared device configured to measure, using a sensor, a distance between the area of the person and the mobile device, the distance based on a time of reflected light at the sensor; 
 determining surface skin properties using the 2D image and physical skin properties using the 3D image, the 3D image comprising a plurality of images each reflecting a different depth of the area on the person, the 3D image having been captured using structured lights used to encode the area of the person; and 
 generating a skin disorder severity assessment using associations between the surface skin properties and the physical skin properties, wherein the physical skin properties comprise an epidermal thickness value, a proliferation of keratinocytes value, an epidermal inflammation value, a blood vessel morphology value, and a keratinocyte morphology value. 
 
 
     
     
       9. The system of  claim 8 , wherein the 2D image represents a surface of skin of the person. 
     
     
       10. The system of  claim 8 , wherein the 3D image comprises a representation of inner layers of skin of the person, the device comprising one or more light projectors configured to emit different colors of the structured lights. 
     
     
       11. The system of  claim 8 , wherein determining the surface skin properties using the 2D image comprises using a trained model to determine the surface skin properties from the 2D image. 
     
     
       12. The system of  claim 8 , wherein the surface skin properties comprise a redness severity score, a scale severity score, and an area severity score. 
     
     
       13. The system of  claim 8 , wherein determining the physical skin properties using the 3D image comprises using a trained model to determine the physical skin properties. 
     
     
       14. The system of  claim 8 , wherein:
 a trained model is used to determine the associations and to generate the skin disorder severity assessment using the associations between the surface skin properties and the physical skin properties; and 
 the skin disorder severity assessment comprises a selection from skin disorder severity labels. 
 
     
     
       15. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:
 receiving, by the processor, a two-dimensional (2D) image and a three-dimensional (3D) image associated with an area of a person; 
 determining, by the processor, surface skin properties using the 2D image and physical skin properties using the 3D image, the 3D image comprising a plurality of images each reflecting a different depth of the area on the person, the 3D image having been captured using structured lights used to encode the area of the person; and 
 generating, by the processor, a skin disorder severity assessment using associations between the surface skin properties and the physical skin properties, wherein the physical skin properties comprise an epidermal thickness value, a proliferation of keratinocytes value, an epidermal inflammation value, a blood vessel morphology value, and a keratinocyte morphology value. 
 
     
     
       16. The computer program product of  claim 15 , wherein the 2D image represents a surface of skin of the person. 
     
     
       17. The computer program product of  claim 15 , wherein the 3D image comprises a representation of inner layers of skin of the person. 
     
     
       18. The computer program product of  claim 15 , wherein determining the surface skin properties using the 2D image comprises using a trained model to determine the surface skin properties from the 2D image.