Generating geometry and texture for volumetric video from 2d images with a limited viewpoint

Abstract

A method for generating a volumetric image of a subject from at least one 2 dimensional image, said at least one 2 dimensional image having a limited number of viewpoints, said volumetric image insertable into an environment.

1 . A method for generating a volumetric image of a subject from at least one 2 dimensional image, said at least one 2 dimensional image having a limited number of viewpoints, said volumetric image insertable into an environment, comprising steps of:
 acquiring said at least one 2 dimensional image;   generating an initial volumetric image from said at least one 2 dimensional image, said initial volumetric image having a volumetric image front and a volumetric image back, said volumetric image front generated from portions of said subject visible in said at least one 2 dimensional image, said volumetric image back generated from portions of said subject not visible in said at least one 2 dimensional image, said volumetric image front having a higher quality than said volumetric image back; and   reducing the quality of said initial volumetric image, said reducing comprising at least one of the following steps:
 reducing a resolution of the volumetric image front to match a quality of the volumetric image back; 
 changing texture of at least a part of said initial volumetric image; 
 simplifying a geometry of said initial volumetric image by changing at least one geometrical feature of said initial volumetric image; 
 simplifying a geometry of said initial volumetric image by reducing resolution of at least one feature of said initial volumetric image; or 
 any combination thereof; 
   thereby generating said volumetric image from said at least one 2 dimensional image.   
     
     
         2 . The method of  claim 1 , additionally comprising a step of providing said texture as a pattern. 
     
     
         3 . The method of  claim 2 , additionally comprising a step of fixing said pattern, said fixing selected from a group consisting of fixing said pattern to a layer on a virtual camera, fixing said pattern to said initial volumetric image, fixing said pattern to said skeleton, fixing said pattern to said center of mass, or fixing said pattern to a fixed point in space. 
     
     
         4 . The method of  claim 1 , additionally comprising a step of selecting said pattern from a group consisting of a pattern of said environment, a proprietary pattern, a user-selected pattern, or a user-generated pattern. 
     
     
         5 . The method of  claim 1 , additionally comprising a step of providing said pattern either changing over time or fixed over time. 
     
     
         6 . The method of  claim 1 , additionally comprising generating said reducing of said quality by a means comprising a member selected from a group consisting of:
 matching a volumetric image geometry style of said initial volumetric image to an environment geometry style of an environment;   reducing said initial volumetric image to a skeleton plus an extent;   reducing said initial volumetric image to a center of mass plus an extent;   applying a pattern to said volumetric image back; and   any combination thereof.   
     
     
         7 . The method of  claim 1 , additionally comprising a step of selecting said higher quality comprising a member of a group consisting of a higher resolution, more detail, fewer artifacts, and any combination thereof. 
     
     
         8 . The method of  claim 1 , additionally comprising a step of selecting said at least a part of said initial volumetric image to be at least a part of said volumetric image back. 
     
     
         9 . A set of instructions that, when executed, are configured to generate a volumetric image of a subject from at least one 2 dimensional image, said at least one 2 dimensional image having a limited number of viewpoints, said volumetric image insertable into an environment, said instructions comprising steps configured to:
 acquire said at least one 2 dimensional image;   generate an initial volumetric image from said at least one 2 dimensional image, said initial volumetric image having a volumetric image front and a volumetric image back, said volumetric image front generated from portions of said subject visible in said at least one 2 dimensional image, said volumetric image back generated from portions of said subject not visible in said at least one 2 dimensional image, said volumetric image front having a higher quality than said volumetric image back; and   reduce the quality of said initial volumetric image, said reducing comprising at least one of the following steps:
 reduce a resolution of the volumetric image front to match a quality of the volumetric image back; 
 change texture of at least a part of said initial volumetric image; 
 simplify a geometry of said initial volumetric image by changing at least one geometrical feature of said initial volumetric image; 
 simplify a geometry of said initial volumetric image by reducing resolution of at least one feature of said initial volumetric image; or 
 any combination thereof. 
   
     
     
         10 . The set of instructions of  claim 9 , wherein said texture is provided as a pattern. 
     
     
         11 . The set of instructions of  claim 10 , wherein said pattern is fixed, said fixing selected from a group consisting of fixed to a layer on a virtual camera, fixed to said initial volumetric image, fixed to said skeleton, fixed to said center of mass, or fixed to a fixed point in space. 
     
     
         12 . The set of instructions of  claim 9 , wherein said pattern is selected from a group consisting of a pattern of said environment, a proprietary pattern, a user-selected pattern, or a user-generated pattern. 
     
     
         13 . The set of instructions of  claim 9 , wherein said pattern is provided either changing over time or fixed over time. 
     
     
         14 . The set of instructions of  claim 9 , wherein said reducing of said quality is generated by a means comprising a member selected from a group consisting of:
 matching a volumetric image geometry style of said initial volumetric image to an environment geometry style of an environment;   reducing said initial volumetric image to a skeleton plus an extent;   reducing said initial volumetric image to a center of mass plus an extent;   applying a pattern to said volumetric image back; and   any combination thereof.   
     
     
         15 . The set of instructions of  claim 9 , wherein said higher quality comprises a member selected from a group consisting of a higher resolution, more detail, fewer artifacts, and any combination thereof. 
     
     
         16 . The set of instructions of  claim 9 , wherein said at least a part of said initial volumetric image is selected to be at least a part of said volumetric image back.