Generating and validating a virtual 3d representation of a real-world structure

Abstract

A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.

1 - 20 . (canceled) 
     
     
         21 . A method for generating a virtual 3D representation of a structure, the method comprising:
 receiving a plurality of images of a real-world structure;   identifying one or more landmarks in each image of the plurality of images;   providing metadata for each image of the plurality of images, wherein the metadata comprises a geometric constraint of each of the identified landmarks in each image of the of the plurality of images;   correlating images of the plurality of images; and   generating the 3D model of the real-world structure based on:
 the identified landmarks in the plurality of images; 
 the correlations between the images of the plurality of images; and 
 the metadata comprising the geometrical constraint for the identified landmarks. 
   
     
     
         22 . The method of  claim 21 , wherein the metadata further comprises a classification of the one or more identified landmarks. 
     
     
         23 . The method of  claim 21 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure. 
     
     
         24 . The method of  claim 23 , wherein the geometric properties comprise a position of the identified landmarks. 
     
     
         25 . The method of  claim 23 , wherein generating the 3D model of the real-world structure comprises generating a surface of the structure based on the identified landmarks. 
     
     
         26 . The method of  claim 25 , further comprising generating one or more other surfaces based on the identified landmarks. 
     
     
         27 . The method of  claim 26 , wherein surfaces comprise one or more of a side of the structure and a back of the structure. 
     
     
         28 . The method of  claim 21 , wherein correlating the images comprises correlating according to the metadata for each image. 
     
     
         29 . The method of  claim 28 , wherein the metadata comprises pose information of a camera associated with each of the images. 
     
     
         30 . The method of  claim 28 , wherein correlating the images comprises correlating according to the geometric constraints of the identified landmarks identified in each of the images. 
     
     
         31 . The method of  claim 30 , wherein the geometric constraints comprise geometric properties associated with the structure. 
     
     
         32 . The method of  claim 31 , wherein the geometric properties comprise a position of the one or more identified landmarks in each of the images. 
     
     
         33 . The method of  claim 21 , wherein correlating the images further comprises generating a data map of correlations between the identified landmarks in different images of the plurality of images. 
     
     
         34 . The method of  claim 21 , further comprising providing a scale for the 3D model. 
     
     
         35 . The method of  claim 34 , wherein the scale is based on measurements of structural aspects within one image of the images. 
     
     
         36 . Non-transitory computer storage media storing instructions that when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:
 receiving a plurality of images of a real-world structure;   identifying one or more landmarks in each image of the plurality of images;   providing metadata for each image of the plurality of images, wherein the metadata comprises a geometric constraint of each of the identified landmarks in each image of the of the plurality of images;   correlating images of the plurality of images; and   generating the 3D model of the real-world structure based on:
 the identified landmarks in the plurality of images; 
 the correlations between the images of the plurality of images; and 
 the metadata comprising the geometrical constraint for the identified landmarks. 
   
     
     
         37 . The non-transitory computer storage media of  claim 36 , wherein the metadata further comprises a classification of the one or more identified landmarks. 
     
     
         38 . The non-transitory computer storage media of  claim 36 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure. 
     
     
         39 . The non-transitory computer storage media of  claim 38 , wherein the geometric properties comprise a position of the identified landmarks. 
     
     
         40 . The non-transitory computer storage media of  claim 38 , wherein generating the 3D model of the real-world structure comprises generating a surface of the structure based on the identified landmarks. 
     
     
         41 . The non-transitory computer storage media of  claim 40 , further comprising generating one or more other surfaces based on the identified landmarks. 
     
     
         42 . The non-transitory computer storage media of  claim 41 , wherein surfaces comprise one or more of a side of the structure and a back of the structure. 
     
     
         43 . The non-transitory computer storage media of  claim 36 , wherein correlating the images comprises correlating according to the metadata for each image. 
     
     
         44 . The non-transitory computer storage media of  claim 43 , wherein the metadata comprises pose information of a camera associated with each of the images. 
     
     
         45 . The non-transitory computer storage media of  claim 44 , wherein correlating the images comprises correlating according to the geometric constraints of the identified landmarks identified in each of the images. 
     
     
         46 . The non-transitory computer storage media of  claim 45 , wherein the geometric constraints comprise geometric properties associated with the structure. 
     
     
         47 . The non-transitory computer storage media of  claim 46 , wherein the geometric properties comprise a position of the one or more identified landmarks in each of the images. 
     
     
         48 . The non-transitory computer storage media of  claim 36 , wherein correlating the images further comprises generating a data map of correlations between the identified landmarks in different images of the plurality of images. 
     
     
         49 . The non-transitory computer storage media of  claim 36 , further comprising providing a scale for the 3D model. 
     
     
         50 . The non-transitory computer storage media of  claim 49 , wherein the scale is based on measurements of structural aspects within one image of the images.