Image display device including moveable display element and image display method

Abstract

An image display device includes a processor that sets a location of a virtual image plane on which a virtual image is formed according to depth information included in first image data and generates second image data obtained by correcting the first image data based on the set location of the virtual image plane; an image forming optical system including a display element configured to modulate light to form a display image according to the second image data and a light transfer unit that forms the virtual image on the virtual image plane, the virtual image corresponding to the display image formed by the display element, the light transfer unit comprising a focusing member; and a drive unit that drives the image forming optical system to adjust the location of the virtual image plane.

What is claimed is: 
     
       1. An image display device comprising:
 a light transfer unit; 
 a drive unit; 
 a display element; and 
 a processor configured to:
 receive image data comprising first frame data corresponding to a first frame and second frame data corresponding to a second frame, the first frame preceding the second frame; 
 determine a difference between a first depth value included in the first frame data and a second depth value included in the second frame data; and 
 generate corrected second frame data based on the determined difference by adjusting a position of a virtual camera in a direction opposite to a direction corresponding to the determined difference or by adjusting a field of view (FOV) of the virtual camera in an FOV opposite to an FOV corresponding to the determined difference, 
 
 wherein the display element is configured to display an image corresponding to the corrected second frame data, and 
 wherein the drive unit is configured to adjust a position of the display element with respect to the light transfer unit based on the determined difference. 
 
     
     
       2. The image display device of  claim 1 , wherein the light transfer unit configured to transfer a first image corresponding to the first frame data and a second image corresponding to the second frame data to a position of an observer, and
 wherein the processor is further configured to determine the first depth value as corresponding to a depth of a first virtual image perceived by the observer when the first image is transferred, and determine the second depth value as corresponding to a depth of a second virtual image perceived by the observer when the second image is transferred. 
 
     
     
       3. The image display device of  claim 1 , wherein the processor is further configured to determine a ratio for resizing the second frame data based on the determined difference and generate the corrected second frame data based on the determined ratio. 
     
     
       4. The image display device of  claim 1 , wherein the processor is further configured to use a correction parameter that offsets a change in magnification according to the difference between the first depth value and the second depth value. 
     
     
       5. The image display device of  claim 1 , wherein the processor is further configured to adjust the position of the virtual camera that is viewing the second frame data. 
     
     
       6. The image display device of  claim 1 , wherein the processor is further configured to adjust the FOV of the virtual camera that is viewing the second frame data. 
     
     
       7. An image display device comprising:
 a light transfer unit; 
 a drive unit; 
 a display element; and 
 a processor configured to:
 receive image data comprising first frame data corresponding to a first frame and second frame data corresponding to a second frame, the first frame preceding the second frame; 
 determine a difference between a first depth value included in the first frame data and a second depth value included in the second frame data; and 
 generate corrected second frame data based on the determined difference, 
 
 wherein the display element is configured to display an image corresponding to the corrected second frame data, 
 wherein the drive unit is configured to adjust a position of the display element with respect to the light transfer unit based on the determined difference, and 
 wherein the processor is further configured to adjust a position of a virtual camera viewing the second frame data based on the determined difference, and generate the corrected second frame data based on the adjusted position of the virtual camera. 
 
     
     
       8. The image display device of  claim 7 , wherein the processor is further configured to adjust a field of view of the virtual camera viewing the second frame data based on the determined difference, and generate the corrected second frame data based on the adjusted field of view of the virtual camera. 
     
     
       9. The image display device of  claim 7 , wherein the light transfer unit configured to transfer a first image corresponding to the first frame data and a second image corresponding to the second frame data to a position of an observer, and
 wherein the processor is further configured to determine the first depth value as corresponding to a depth of a first virtual image perceived by the observer when the first image is transferred, and determine the second depth value as corresponding to a depth of a second virtual image perceived by the observer when the second image is transferred. 
 
     
     
       10. The image display device of  claim 7 , wherein the processor is further configured to determine a ratio for resizing the second frame data based on the determined difference and generate the corrected second frame data based on the determined ratio. 
     
     
       11. The image display device of  claim 7 , wherein the processor is further configured to use a correction parameter that offsets a change in magnification according to the difference between the first depth value and the second depth value. 
     
     
       12. An image display device comprising:
 a light transfer unit; 
 a drive unit; 
 a display element; and 
 a processor configured to:
 receive image data comprising first frame data corresponding to a first frame and second frame data corresponding to a second frame, the first frame preceding the second frame; 
 determine a difference between a first depth value included in the first frame data and a second depth value included in the second frame data; and 
 generate corrected second frame data based on the determined difference, 
 
 wherein the display element is configured to display an image corresponding to the corrected second frame data, 
 wherein the drive unit is configured to adjust a position of the display element with respect to the light transfer unit based on the determined difference, and 
 wherein the processor is further configured to adjust a field of view of a virtual camera viewing the second frame data based on the determined difference, and generate the corrected second frame data based on the adjusted field of view of the virtual camera. 
 
     
     
       13. The image display device of  claim 12 , wherein the processor is further configured to adjust a position of the virtual camera viewing the second frame data based on the determined difference, and generate the corrected second frame data based on the adjusted position of the virtual camera. 
     
     
       14. The image display device of  claim 12 , wherein the light transfer unit configured to transfer a first image corresponding to the first frame data and a second image corresponding to the second frame data to a position of an observer, and
 wherein the processor is further configured to determine the first depth value as corresponding to a depth of a first virtual image perceived by the observer when the first image is transferred, and determine the second depth value as corresponding to a depth of a second virtual image perceived by the observer when the second image is transferred. 
 
     
     
       15. The image display device of  claim 12 , wherein the processor is further configured to determine a ratio for resizing the second frame data based on the determined difference and generate the corrected second frame data based on the determined ratio. 
     
     
       16. The image display device of  claim 12 , wherein the processor is further configured to use a correction parameter that offsets a change in magnification according to the difference between the first depth value and the second depth value.