Structuring visual data

Abstract

Mappings are determined between viewpoints of an object and an object model representing the object. Each mapping identifies a location on the object model corresponding with a portion of the object captured in one of the viewpoints. Tags for the object model are created based on the mappings, where each tag links one of the viewpoints to one of the locations on the object model. A user interface that includes the object model and the tags is provided for presentation on a display screen in a user interface. One of the viewpoints is presented in the user interface when the corresponding tag is selected in the object model.

The invention claimed is: 
     
       1. A method comprising:
 determining a respective mapping between each of a plurality of viewpoints of a vehicle and a vehicle model representing the vehicle, each mapping identifying a location on the vehicle model corresponding with a portion of the vehicle captured in the respective viewpoint; 
 automatically detecting, using artificial intelligence, defects associated with the vehicle; 
 creating a plurality of tags for the vehicle model based on the mappings, each tag linking one or more of the viewpoints to a respective one of the locations on the vehicle model, one or more of the tags corresponding to the defects; and 
 providing for presentation on a display screen a user interface that includes the vehicle model and the tags, the user interface presenting a designated one of the plurality of viewpoints when a designated tag corresponding with the designated viewpoint is selected in the vehicle model. 
 
     
     
       2. The method of  claim 1 , wherein the tags are represented in the user interface with green circles. 
     
     
       3. The method of  claim 1  further comprising:
 responsive to detecting the defects automatically producing high resolution images of locations associated with the defects. 
 
     
     
       4. The method recited in  claim 1 , wherein the designated tag is mapped to a set of the viewpoints including the designated viewpoint, and wherein each of the set of viewpoints is presented when the designated viewpoint is selected. 
     
     
       5. The method recited in  claim 1 , wherein determining the respective mapping comprises identifying an object component represented in the respective viewpoint. 
     
     
       6. The method recited in  claim 1 , the method further comprising:
 determining whether a designated object component is represented in the plurality of viewpoints; and 
 when it is determined that the designated object component is not represented in the plurality of viewpoints, providing recording guidance via a user interface at a computing device to facilitate capture of the designated object component in an additional viewpoint of the object. 
 
     
     
       7. The method recited in  claim 6 , wherein the recording guidance is provided via an overlay presented on a live camera feed at a smartphone. 
     
     
       8. A cloud-based system comprising:
 a remote server system comprising one or more processors configurable to cause:
 determining a respective mapping between each of a plurality of viewpoints of a vehicle and a vehicle model representing the vehicle, each mapping identifying a location on the vehicle model corresponding with a portion of the vehicle captured in the respective viewpoint; 
 automatically detecting, using artificial intelligence, defects associated with the vehicle; 
 
 creating a plurality of tags for the vehicle model based on the mappings, each tag linking one or more of the viewpoints to a respective one of the locations on the vehicle model, one or more of the tags corresponding to the defects; and 
 providing for presentation on a display screen a user interface that includes the vehicle model and the tags, the user interface presenting a designated one of the plurality of viewpoints when a designated tag corresponding with the designated viewpoint is selected in the vehicle model. 
 
     
     
       9. The cloud-based system of  claim 8 , wherein the tags are represented in the user interface with green circles. 
     
     
       10. The cloud-based system of  claim 8 , the one or more processors further configurable to cause:
 responsive to detecting the defects automatically producing high resolution images of locations associated with the defects. 
 
     
     
       11. The cloud-based system of  claim 8  wherein the designated tag is mapped to a set of the viewpoints including the designated viewpoint, and wherein each of the set of viewpoints is presented when the designated viewpoint is selected. 
     
     
       12. The cloud-based system of  claim 8 , wherein determining the respective mapping comprises identifying an object component represented in the respective viewpoint. 
     
     
       13. The cloud-based system of  claim 8 , the one or more processors further configurable to cause:
 determining whether a designated object component is represented in the plurality of viewpoints; and 
 when it is determined that the designated object component is not represented in the plurality of viewpoints, providing recording guidance via a user interface at a computing device to facilitate capture of the designated object component in an additional viewpoint of the object. 
 
     
     
       14. The cloud-based system of  claim 13 , wherein the recording guidance is provided via an overlay presented on a live camera feed at a smartphone. 
     
     
       15. One or more non-transitory machine-readable media having instructions stored thereon for performing a method, the method comprising:
 determining a respective mapping between each of a plurality of viewpoints of a vehicle and a vehicle model representing the vehicle, each mapping identifying a location on the vehicle model corresponding with a portion of the vehicle captured in the respective viewpoint; 
 automatically detecting, using artificial intelligence, defects associated with the vehicle; 
 creating a plurality of tags for the vehicle model based on the mappings, each tag linking one or more of the viewpoints to a respective one of the locations on the vehicle model, one or more of the tags corresponding to the defects; and 
 providing for presentation on a display screen a user interface that includes the vehicle model and the tags, the user interface presenting a designated one of the plurality of viewpoints when a designated tag corresponding with the designated viewpoint is selected in the vehicle model. 
 
     
     
       16. The one or more non-transitory machine-readable media of  claim 15 , wherein the tags are represented in the user interface with green circles. 
     
     
       17. The one or more non-transitory machine-readable media of  claim 15 , the method further comprising:
 responsive to detecting the defects automatically producing high resolution images of locations associated with the defects. 
 
     
     
       18. The one or more non-transitory machine-readable media of  claim 15 , wherein the designated tag is mapped to a set of the viewpoints including the designated viewpoint, and wherein each of the set of viewpoints is presented when the designated viewpoint is selected. 
     
     
       19. The one or more non-transitory machine-readable media of  claim 15 , wherein determining the respective mapping comprises identifying an object component represented in the respective viewpoint. 
     
     
       20. The one or more non-transitory machine-readable media of  claim 15 , the method further comprising:
 determining whether a designated object component is represented in the plurality of viewpoints; and 
 when it is determined that the designated object component is not represented in the plurality of viewpoints, providing recording guidance via a user interface at a computing device to facilitate capture of the designated object component in an additional viewpoint of the object.