Building data models by using light to determine material properties of illuminated objects

Abstract

Disclosed are methods and systems for building data models by using light to determine material properties of illuminated objects. In an embodiment, a system includes a set of device pairs (of lighting-source and image-capture devices) arranged on the perimeter (and directed at a central region of) a 3D shape. The system iterates from an initial state through a plurality of imaging states. The initial state involves (1) an object being situated in a controlled-lighting space and (2) the device pairs being positioned within the controlled-lighting space and around the object, which is situated in the central region of the 3D shape. Each imaging state involves the activation of an imaging-state-specific subset of lighting-source and image-capture devices. The system captures image data indicative of the appearance of the object during the imaging states, and stores that data in a 3D-data model of the object.

We claim: 
     
       1. A method comprising:
 a system iterating from an initial state through a plurality of imaging states, wherein:
 the system comprises a processor and data storage containing instructions executable by the processor for carrying out the method, 
 the system comprises a set of device pairs, each device pair comprising a lighting-source device and an image-capture device, 
 the initial state involves (1) an object being situated in a controlled-lighting space and (2) the set of device pairs being positioned within the controlled-lighting space and substantially around the object, and 
 each imaging state involves (1) the activation of an imaging-state-specific subset of the lighting-source devices in an imaging-state-specific manner and (2) the activation of an imaging-state-specific subset of the image-capture devices; 
 
 the system receiving image data that is indicative of a respective appearance and composition of the object during the iteration through the respective imaging states; 
 determining, based on the image data, information indicative of a plurality of separate regions in the object that are of a substantially similar appearance and composition; and 
 the system storing the image data as data structures of a 3D-data model of the object, wherein the data stored is indicative of one or more properties of the appearance and composition of the object and the information indicative of the plurality of separate regions in the object that are of the substantially similar appearance and composition. 
 
     
     
       2. The method of  claim 1 , wherein one or more of the lighting-source devices is arranged to emit one or more of visible light, infrared light, ultraviolet light, and laser light. 
     
     
       3. The method of  claim 1 , wherein one or more of the device pairs has its respective lighting-source device and its respective image-capture device directed substantially along the same respective optical ray. 
     
     
       4. The method of  claim 1 , wherein the controlled-lighting space substantially resembles a 3D shape that comprises a sphere, a cube, a rectangular box, or a canister. 
     
     
       5. The method of  claim 1 , wherein the plurality of imaging states comprises a first imaging state that involves activation of all of the lighting-source devices of the system and all of the image-capture devices of the system. 
     
     
       6. The method of  claim 1 , wherein the plurality of imaging states comprises a round-robin set of imaging states, wherein the round-robin set includes a respective state in which each respective lighting-source device is activated one at a time. 
     
     
       7. The method of  claim 6 , wherein, in connection with each respective imaging state in the round-robin set, the only image-capture device in the set of device pairs that is activated is the image-capture device that is paired with the activated lighting-source device. 
     
     
       8. The method of  claim 6 , wherein, in connection with each respective imaging state in the round-robin set, the system activates every image-capture device in the set of device pairs. 
     
     
       9. The method of  claim 6 , wherein, in connection with each respective imaging state in the round-robin set, the system activates every image-capture device in the set of device pairs except for the image-capture device that is paired with the activated lighting-source device. 
     
     
       10. The method of  claim 1 , wherein at least one activation of an imaging-state-specific subset of the lighting-source devices of the system in an imaging-state-specific manner comprises setting at least one of a color of the light and an intensity of the light emitted by at least one lighting-source device in that particular imaging-state-specific subset. 
     
     
       11. The method of  claim 1 , wherein storing the image data as data structures of the 3D-data model of the object comprises storing multiple meshes segmented by material type. 
     
     
       12. The method of  claim 1 , wherein the one or more properties of the appearance and composition of the object include one or more of type of material, color, translucence, brightness, reflectivity, luminescence, and heat signature. 
     
     
       13. The method of  claim 1 , further comprising the system receiving, through a transparent surface, image data representative of an appearance and composition of a bottom of the object. 
     
     
       14. The method of  claim 1 , further comprising the system using one or more of x-rays, memory foam, and a push-pin arrangement to receive data representative of an appearance and composition of a bottom of the object. 
     
     
       15. The method of  claim 1 , further comprising:
 comparing the image data corresponding to one or more of the imaging states with image data that is stored in a reference database and that corresponds to the one or more of the imaging states; and 
 the system, based on the comparing, selecting values from the reference database to be stored in the 3D-data model of the object as being indicative of one or more properties of the appearance and composition of the object. 
 
     
     
       16. A system comprising:
 a set of device pairs, each device pair comprising a lighting-source device and an image-capture device; 
 a processor; and 
 data storage containing instructions executable by the processor for carrying out a set of functions, the set of functions including:
 iterating from an initial state through a plurality of imaging states, wherein:
 the initial state involves (1) an object being situated in a controlled-lighting space and (2) the set of device pairs being positioned within the controlled-lighting space and substantially around the object, and 
 each imaging state involves (1) the activation of an imaging-state-specific subset of the lighting-source devices in an imaging-state-specific manner and (2) the activation of an imaging-state-specific subset of the image-capture devices; 
 
 receiving image data that is indicative of a respective appearance and composition of the object during the iteration through the respective imaging states; 
 determining, based on the image data, information indicative of a plurality of regions in the object that are of a substantially similar appearance and composition; and 
 storing the image data as data structures of a 3D-data model of the object, wherein the data stored is indicative of one or more properties of the appearance and composition of the object and the information indicative of the plurality of regions in the object that are of the substantially similar appearance and composition. 
 
 
     
     
       17. The system of  claim 16 , wherein one or more of the lighting-source devices comprises one or more light-emitting diodes. 
     
     
       18. The system of  claim 16 , wherein one or more of the lighting-source devices is arranged to emit one or more of visible light, infrared light, ultraviolet light, and laser light. 
     
     
       19. The system of  claim 16 , wherein one or more of the image-capture devices comprises a digital camera. 
     
     
       20. The system of  claim 19 , wherein at least one digital camera comprises a digital single-lens reflex camera. 
     
     
       21. The system of  claim 16 , wherein one or more of the device pairs has its respective lighting-source device and its respective image-capture device directed substantially along the same respective optical ray. 
     
     
       22. The system of  claim 16 , wherein the controlled-lighting space substantially resembles a 3D shape that comprises a sphere, a cube, a rectangular box, or a canister. 
     
     
       23. The system of  claim 16 , wherein the controlled-lighting space substantially resembles a 3D shape, and wherein the device pairs in the set of device pairs collectively substantially form the 3D shape. 
     
     
       24. The system of  claim 16 , wherein the controlled-lighting space substantially resembles a 3D shape, and wherein the device pairs in the set of device pairs are spaced apart about a perimeter of the 3D shape. 
     
     
       25. The system of  claim 16 , the set of functions further including the system using one or more of x-rays, memory foam, and a push-pin arrangement to receive data representative of an appearance and composition of a bottom of the object. 
     
     
       26. The system of  claim 25 , wherein one or more of the push pins in the push-pin arrangement comprises at least one of a lighting-source device, an image-capture device, and a pressure sensor. 
     
     
       27. The system of  claim 16 , arranged to carry out the set of functions in a zero-gravity environment. 
     
     
       28. The system of  claim 16 , arranged to carry out the set of functions in an environment that is submerged in a fluid. 
     
     
       29. A non-transitory computer-readable medium having stored thereon instructions executable by a processor for causing a system to carry out a set of functions, the set of functions including:
 iterating from an initial state through a plurality of imaging states, wherein:
 the system comprises a set of device pairs, each device pair comprising a lighting-source device and an image-capture device, 
 the initial state involves (1) an object being situated in a controlled-lighting space and (2) the set of device pairs being positioned within the controlled-lighting space and substantially around the object, and 
 each imaging state involves (1) the activation of an imaging-state-specific subset of the lighting-source devices in an imaging-state-specific manner and (2) the activation of an imaging-state-specific subset of the image-capture devices; 
 
 receiving image data that is indicative of a respective appearance and composition of the object during the iteration through the respective imaging states; 
 determining, based on the image data, information indicative of a plurality of separate regions in the object that are of a substantially similar appearance and composition; and 
 storing the image data as data structures of a 3D-data model of the object, wherein the data stored is indicative of one or more properties of the appearance and composition of the object and the information indicative of the plurality of separate regions in the object that are of the substantially similar appearance and composition. 
 
     
     
       30. The method of  claim 1 , further comprising:
 determining, based on the image data, one or more properties of the plurality of separate regions in the object that correspond to an optical property of a material type of the plurality of separate regions due to interaction with light from the lighting-source device.