Generating and validating a virtual 3d representation of a real-world structure

Abstract

A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.

1 - 20 . (canceled) 
     
     
         21 . A method for generating a virtual 3D representation of a structure, the method comprising:
 receiving a plurality of images of a real-world structure;   identifying one or more landmarks in each image of the plurality of images;   providing metadata for the one or more identified landmarks in each image of the plurality of images, wherein the metadata comprises a geometric constraint of the one or more identified landmarks;   correlating a first landmark of the one more of the identified landmarks in a first image of the plurality of images with a second landmark of the one or more identified landmarks in a second image of the plurality of images; and   generating a 3D representation of the real-world structure based on:
 the identified landmarks in the plurality of images; 
 the correlations between the first and second identified landmarks; and 
 the metadata comprising the geometrical constraints for the identified landmarks. 
   
     
     
         22 . The method of  claim 21 , wherein the metadata further comprises a classification of the one or more identified landmarks. 
     
     
         23 . The method of  claim 21 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure. 
     
     
         24 . The method of  claim 23 , wherein the geometric properties comprise a position of the identified landmarks. 
     
     
         25 . The method of  claim 23 , wherein generating the 3D representation of the real-world structure comprises generating a surface of the structure based on the identified landmarks. 
     
     
         26 . The method of  claim 25 , further comprising generating one or more other surfaces based on the identified landmarks. 
     
     
         27 . The method of  claim 26 , wherein the surfaces comprise one or more of a side of the structure and a back of the structure. 
     
     
         28 . The method of  claim 21 , wherein correlating the first identified landmark further comprises correlating the first identified landmark to the second identified landmark according to the metadata of the first and second identified landmarks. 
     
     
         29 . The method of  claim 28 , wherein the geometric constraints of the first and second identified landmarks comprise geometric properties associated with the structure. 
     
     
         30 . The method of  claim 29 , wherein the geometric properties comprise a position of the first and second identified landmarks. 
     
     
         31 . The method of  claim 21 , wherein correlating the first identified landmark further comprises generating a data map of correlations between the first and second identified landmarks. 
     
     
         32 . The method of  claim 21 , further comprising providing a scale for the 3D model. 
     
     
         33 . The method of  claim 29 , where the scale is based on measurements of structural aspects within an image of the plurality of images. 
     
     
         34 . Non-transitory computer storage media storing instructions that when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:
 receiving a plurality of images of a real-world structure;   identifying one or more landmarks in each image of the plurality of images;   providing metadata for the one or more identified landmarks in each image of the plurality of images, wherein the metadata comprises a geometric constraint of the one or more identified landmarks;   correlating a first landmark of the one more of the identified landmarks in a first image of the plurality of images with a second landmark of the one or more identified landmarks in a second image of the plurality of images; and   generating a 3D representation of the real-world structure based on:
 the identified landmarks in the plurality of images; 
 the correlations between the first and second identified landmarks; and 
 the metadata comprising the geometrical constraints for the identified landmarks. 
   
     
     
         35 . The non-transitory computer storage media of  claim 34 , wherein the metadata further comprises a classification of the one or more identified landmarks. 
     
     
         36 . The non-transitory computer storage media of  claim 34 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure. 
     
     
         37 . The non-transitory computer storage media of  claim 36 , wherein the geometric properties comprise a position of the identified landmarks. 
     
     
         38 . The non-transitory computer storage media of  claim 36 , wherein generating the 3D representation of the real-world structure comprises generating a surface of the structure based on the identified landmarks. 
     
     
         39 . The non-transitory computer storage media of  claim 38 , further comprising generating one or more other surfaces based on the identified landmarks. 
     
     
         40 . The non-transitory computer storage media of  claim 39 , wherein the surfaces comprise one or more of a side of the structure and a back of the structure. 
     
     
         41 . The non-transitory computer storage media of  claim 34 , wherein correlating the first identified landmark further comprises correlating the first identified landmark to the second identified landmark according to the metadata of the first and second identified landmarks. 
     
     
         42 . The non-transitory computer storage media of  claim 41 , wherein the geometric constraints of the first and second identified landmarks comprise geometric properties associated with the structure. 
     
     
         43 . The non-transitory computer storage media of  claim 42 , wherein the geometric properties comprise a position of the first and second identified landmarks. 
     
     
         44 . The non-transitory computer storage media of  claim 34 , wherein correlating the first identified landmark further comprises generating a data map of correlations between the first and second identified landmarks. 
     
     
         45 . The non-transitory computer storage media of  claim 34 , further comprising providing a scale for the 3D model. 
     
     
         46 . The non-transitory computer storage media of  claim 45 , where the scale is based on measurements of structural aspects within an image of the plurality of images.