Method and sytem for generating at least one image of a real environment

Abstract

A method of generating at least one image of a real environment comprises providing at least one environment property related to at least part of the real environment, providing at least one virtual object property related to a virtual object, determining at least one imaging parameter according to the at least one provided virtual object property and the at least one provided environment property, and generating at least one image of the real environment representing information about light leaving the real environment according to the determined at least one imaging parameter, wherein the light leaving the real environment is measured by at least one camera.

1 . A method of generating at least one image of a real environment, the method comprising
 a) providing at least one environment property related to at least part of the real environment,   b) providing at least one virtual object property related to a virtual object having a spatial relation to the real environment,   c) determining at least one imaging parameter according to the at least one provided virtual object property and the at least one provided environment property,   d) generating at least one image of the real environment representing information about light leaving the real environment according to the determined at least one imaging parameter, wherein the light leaving the real environment is measured by at least one camera.   
     
     
         2 . The method according to  claim 1 , wherein the step of generating at least one image of the real environment comprises a first step of measuring light and generating measured light data from the measuring, and a second step of processing the measured light data into an image. 
     
     
         3 . The method according to  claim 1 , wherein the generated at least one image only contains information related to the real environment. 
     
     
         4 . The method according to  claim 1 , wherein the generated at least one image of the real environment is at least one first image, and the at least one environment property is determined according to pixel information of at least one second image of the real environment captured by the at least one camera. 
     
     
         5 . The method according to  claim 4 , wherein the at least one second image of the real environment is captured by the at least one camera before the at least one first image is generated. 
     
     
         6 . The method according to  claim 1 , wherein the at least one environment property comprises at least one or more of: brightness, distance, position and orientation, wherein at least one of which is measured by at least one or more of: a light sensor, an orientation sensor, a positioning sensor, and a distance sensor. 
     
     
         7 . The method according to  claim 1 , wherein step d) comprises measuring incident light from the real environment by the at least one camera according to the at least one imaging parameter, and processing the measured incident light into pixel values of the at least one image. 
     
     
         8 . The method according to  claim 7 , wherein the step of measuring the incident light comprises configuring at least one optical component of the at least one camera according to the at least one imaging parameter. 
     
     
         9 . The method according to  claim 8 , wherein the at least one optical component comprises at least one or more of: a lens, an aperture, and a shutter. 
     
     
         10 . The method according to  claim 9 , wherein the at least one imaging parameter comprises at least one or more of: a focus distance, focal length, lens position, aperture, aperture size, shutter time, exposure time, sensor sensitivity, gain. 
     
     
         11 . The method according to  claim 1 , wherein step d) comprises measuring incident light from the real environment by the at least one camera, and processing the measured incident light into pixel values of the at least one image according to the at least one imaging parameter. 
     
     
         12 . The method according to  claim 11 , wherein the at least one imaging parameter comprises at least one or more of: a post focus, blurriness, sharpness, tone mapping. 
     
     
         13 . The method according to  claim 1 , wherein step d) comprises measuring incident light from the real environment by the at least one camera according to at least part of the at least one imaging parameter, and processing the measured incident light into pixel values of the at least one image according to at least part of the at least one imaging parameter. 
     
     
         14 . The method according to  claim 1 , wherein the at least one virtual object property includes at least one or more of: at least part of a pose of the virtual object relative to the at least one camera, at least part of a pose of the virtual object relative to at least part of the real environment, a visual property of the virtual object, a geometrical property of the virtual object, and a property describing how the virtual object influences the at least one imaging parameter, in particular should pull the focus of the at least one camera or the virtual object should be brighter than anything in the environment. 
     
     
         15 . The method according to  claim 1 , wherein the at least one environment property includes at least one or more of: at least part of a pose of at least part of the real environment relative to the at least one camera, at least part of a pose of at least part of the real environment relative to the virtual object, a visual property of the real environment, a geometric property of the real environment. 
     
     
         16 . The method according to  claim 9 , wherein the at least one imaging parameter includes at least one or more of: a focus, exposure time, flash setting, torch setting, ISO, dynamic range, lens position, Device's Configuration, (Color) Formats, Focus Settings, Exposure Settings, Zoom Settings, Flash Settings, Torch Settings, Low Light Settings, Frame Rate Settings, Subject Area, Device Characteristics, Lens Position, Image Exposure, White Balance, ISO, High Dynamic Range Video, resolution, framerate, shutter mode, bit depth, gamma correction, black level adjustment, noise reduction, edge enhancement, constrast enhancement, false chroma suppression, chroma subsampling, chroma resampling, color transformation, image compression, rolling shutter. 
     
     
         17 . The method according to  claim 11 , wherein the at least one imaging parameter includes at least one or more of: debayering, Filter Pattern Compensation, Rolling shutter compensation, sensor offset bias correction, pixel defects correction, lens shading (vignetting) compensation (optical vignetting, pixel vignetting), dark frame subtract, white balance, demosiac, denoise/sharpen, gamma correction, color space conversion, chroma subsampling, compression, quantization, tone mapping, blooming, blurring, defocus, convolution, deconvolution, filtering, NPR, toon shading, half toning, silhuette rendering. 
     
     
         18 . The method according to  claim 1 , wherein step c) comprises determining at least one value for the at least one imaging parameter. 
     
     
         19 . The method according to  claim 1 , wherein step c) comprises determining a type of the at least one imaging parameter according to the at least one virtual object property. 
     
     
         20 . The method according to  claim 1 , wherein the at least one imaging parameter comprises at least one pose determination imaging parameter and at least one visualization imaging parameter. 
     
     
         21 .- 39 . (canceled)