Method and apparatus for 3D model creation based on 2D images

Abstract

A method in accordance with the invention comprises the step of providing a) pixel array and a computer model of a geometric surface, and b) providing a second array (a Z array) containing information concerning the 3D characteristics of the structure depicted in the pixel array. The Z array is used to modify the location of the geometric surface. The pixel array and modified geometric surface are then used to render an image that can be displayed on a CRT or other output device. By modifying the geometric surface model in this way, it is possible to create more realistic images.

We claim:  
     
         1 . A method for forming an image comprising the acts of: 
 providing an array of pixels;    providing a mesh of geometric surfaces;    providing displacement information;    modifying the position of said geometric surfaces as a function of said displacement information;    binding said mesh of geometric surfaces to said array of pixels; and    rendering an image based on said array of pixels and said modified geometric surfaces.    
     
     
         2 . Method of  claim 1  wherein said displacement information is in the form of an array of displacement values, said method further comprising the step of subjecting said displacement values to a filtering step.  
     
     
         3 . Method of  claim 2  further comprising the step of applying an image analyzer to said pixel array to generate said displacement values.  
     
     
         4 . Method of  claim 3  wherein said image analyzer is used to bind said pixel array to said geometric surfaces.  
     
     
         5 . Method of  claim 3  wherein vertices of said geometric surfaces corresponding to control points within said pixel array are offset by a value proportional to said displacement values.  
     
     
         6 . Structure comprising. 
 a first memory for storing the location of one or more geometric surfaces;    a second memory for storing a pixel array, the pixels in said pixel array depicting an image;    a third memory for storing information concerning 3D characteristics of said image;    a circuit for binding said pixel array to said one or more geometric surfaces, and    a circuit for altering the location of said one or more geometric surfaces as a function of the information in said third memory.    
     
     
         7 . A method for forming an image comprising the acts of: 
 providing an array of pixels;    providing a computer model of a geometric surface,    providing displacement information;    modifying the position of said geometric surface as a function of said displacement information;    binding said geometric surface to said array of pixels; and    rendering an image based on said array of pixels and said modified geometric surface.