US12079922B2ActiveUtilityA1

System and method for translating a 2D image to a 3D image

76
Assignee: XEROX CORPPriority: Dec 30, 2020Filed: Jan 9, 2023Granted: Sep 3, 2024
Est. expiryDec 30, 2040(~14.5 yrs left)· nominal 20-yr term from priority
G06T 15/80G06T 15/04G06T 17/05G06T 15/10
76
PatentIndex Score
0
Cited by
11
References
20
Claims

Abstract

A system and method for translating a 2D image to a 3D image is provided. A 2D image having pixels grouped into tiles is obtained. Contour lines associated with an altitude value are located on the 2D image. The altitude values are determined. Each tile in the 2D image is represented using at least one voxel. A height map of the voxels is generated based on the contour lines and altitude values as a base layer for a 3D image. A terrain type of each of the voxels of the 3D image is determined and objects are placed in the 3D image. The 3D image is output.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A system for translating a 2D image to a 3D image, comprising:
 a database configured to store a 2D image comprising pixels grouped into tiles; and 
 a server comprising a central processing unit, memory, an input port to receive the 2D image from the database, and an output port, wherein the central processing unit is configured to:
 locate on the 2D image contour lines each associated with an altitude value; 
 determine the altitude values based on the contour lines; 
 represent the tiles with voxels, comprising:
 compare each tile to a set of layer expansion templates, wherein each layer expansion template represents a terrain texture and a terrain color; 
 identify one of the layer expansion templates that best matches each tile; and 
 generate each voxel corresponding to one of the tiles based on the identified layer expansion template that best matches that tile; 
 
 generate a height map of the voxels based on the contour lines and altitude values as a base layer for a 3D image; 
 place objects in the 3D image; and 
 output the 3D image. 
 
 
     
     
       2. The method according to  claim 1 , wherein the central processing unit reads the altitude values using optical character recognition to determine the altitude values. 
     
     
       3. The method according to  claim 1 , wherein the central processing unit sweeps a trained classifier over cropped regions of the 2D image to determine the altitude values. 
     
     
       4. The method according to  claim 1 , wherein the central processing unit accesses object templates and selects the objects for placement in the 3D image via the object templates. 
     
     
       5. The method according to  claim 1 , wherein the central processing unit accesses a map legend for use with the 3D image. 
     
     
       6. The method according to  claim 1 , wherein the central processing unit accesses the layer expansion templates and identifies the terrain type provided via the accessed layer expansion templates. 
     
     
       7. The method according to  claim 6 , wherein the central processing unit colors the voxels based on the terrain type using the layer expansion templates. 
     
     
       8. The method according to  claim 6 , wherein the layer expansion templates provide instructions for the tiles of the 2D image to scale to the output voxel size of the 3D image. 
     
     
       9. The method according to  claim 6 , wherein the layer expansion templates comprise color, texturing, and shadowing instructions for the tiles, which are each associated with the terrain type and object type. 
     
     
       10. The method according to  claim 6 , wherein the central processing unit translates the 3D image back into the 2D image. 
     
     
       11. A method for translating a 2D image to a 3D image, comprising:
 obtaining a 2D image comprising pixels grouped into tiles; 
 locating on the 2D image contour lines each associated with an altitude value; 
 determining the altitude values based on the contour lines; 
 representing the tiles with voxels, comprising:
 comparing each tile to a set of layer expansion templates, wherein each layer expansion template represents a terrain texture and a terrain color; 
 identifying one of the layer expansion templates that best matches each tile; and 
 generating each voxel corresponding to one of the tiles based on the identified layer expansion template that best matches that tile; 
 
 generating a height map of the voxels based on the contour lines and altitude values as a base layer for a 3D image; 
 placing objects in the 3D image; and 
 outputting the 3D image. 
 
     
     
       12. The method according to  claim 11 , further comprising:
 reading the altitude values from contour lines using optical character recognition to determine the altitude values. 
 
     
     
       13. The method according to  claim 11 , further comprising:
 sweeping a trained classifier over cropped regions of the 2D image to determine the altitude values. 
 
     
     
       14. The method according to  claim 13 , further comprising:
 accessing object templates; and 
 selecting the objects for placement in the 3D image via the object templates. 
 
     
     
       15. The method according to  claim 11 , further comprising:
 accessing a map legend for use with the 3D image. 
 
     
     
       16. The method according to  claim 11 , further comprising:
 Accessing the layer expansion templates; and 
 applying the terrain type provided via the accessed layer expansion templates. 
 
     
     
       17. The method according to  claim 16 , further comprising:
 coloring the voxels based on the terrain type using the layer expansion templates. 
 
     
     
       18. The method according to  claim 16 , wherein the layer expansion templates provide instructions for the tiles of the 2D image to scale to the output voxel size of the 3D image. 
     
     
       19. The method according to  claim 16 , wherein the layer expansion templates comprise color, texturing, and shadowing instructions for the tiles, which are each associated with the terrain type and object type. 
     
     
       20. The method according to  claim 11 , further comprising:
 translating the 3D image back into the 2D image.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.