Projection of an image in an extended reality device

Abstract

A method for controlling projection of an image in an extended reality device is disclosed. The extended reality device comprising an optical element, a display, and a motion tracker, wherein the optical element and/or the display are mounted movement flexible in the extended reality device. The method comprises obtaining motion information of the extended reality device from the motion tracker; determining a compensating movement of the optical element and/or the display for projection of the image based on the obtained motion information of the extended reality device; and controlling projection of the image by moving the optical element and/or the display based on the determined compensating movement. Corresponding computer program product, apparatus, and extended reality headset are also disclosed.

The invention claimed is: 
     
       1. A method for controlling projection of an image in an extended reality device comprising an optical element, a display, and a motion tracker, wherein the optical element and/or the display are mounted movement flexible in the extended reality device, the method comprising the steps of:
 obtaining motion information of the extended reality device from the motion tracker; 
 determining a compensating movement of the optical element and/or the display for projection of the image based on the obtained motion information of the extended reality device; and 
 controlling projection of the image by moving the optical element and/or the display based on the determined compensating movement, wherein 
 the projection comprises an extended reality scene, 
 the extended reality scene is rendered with a projected position and direction of a viewer's eyes, and 
 the projected position and direction are compared to the obtained motion information and compensated for. 
 
     
     
       2. A computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions, the computer program being loadable into a data processing unit and configured to cause execution of the method of  claim 1  when the computer program is run by the data processing unit. 
     
     
       3. An apparatus for controlling projection of an image in an extended reality device, wherein the extended reality device comprises an optical element, a display, and a motion tracker, and wherein the optical element and/or the display are mounted movement flexible in the extended reality device, the apparatus comprising:
 a controller comprising a processor configured to cause the apparatus to: 
 obtain motion information of the extended reality device from the motion tracker; 
 determine a compensating movement of the optical element and/or the display for projection of the image based on the obtained motion information of the extended reality device; and 
 control projection of the image by movement of the optical element and/or the display based on the determined compensating movement, wherein 
 the projection comprises an extended reality scene, 
 the extended reality scene is rendered with a projected position and direction of a viewer's eyes, and 
 the projected position and direction are compared to the obtained motion information and compensated for. 
 
     
     
       4. The apparatus of  claim 3 , the controller being further configured to cause:
 obtainment of position information for the image to be displayed from controlling circuitry operably connected to the extended reality device; 
 obtainment of timing information for when the image is to be displayed from controlling circuitry operably connected to the extended reality device; and 
 display of the image based on the obtained position information and the timing information. 
 
     
     
       5. The apparatus of  claim 3 , the controller being further configured to cause:
 obtainment of virtual motion information of objects in an extended reality environment from controlling circuitry operably connected to the extended reality device; and 
 determination of the compensating movement of the optical element and/or the display for projection of the image based on the obtained virtual motion information of the objects in the extended reality environment. 
 
     
     
       6. The apparatus of  claim 5 , wherein the virtual motion information of objects in the extended reality environment comprises virtual position and/or virtual movement information. 
     
     
       7. The apparatus of  claim 3 , wherein the motion information of the extended reality device comprises position and/or movement information. 
     
     
       8. The apparatus of  claim 3 , wherein the control of projection of the image comprises mechanical control by movement of the optical element and/or the display based on the determined compensating movement. 
     
     
       9. The apparatus of  claim 3 , wherein any one action caused by the controller is performed continuously for controlling projection of the image continuously in the extended reality device. 
     
     
       10. The apparatus of  claim 3 , wherein the projection comprises an asynchronous reprojection. 
     
     
       11. The apparatus of  claim 3 , the controller being further configured to cause:
 reset of the optical element and/or the display to a start position for displaying a next image. 
 
     
     
       12. The apparatus of  claim 11 , wherein reset of the display comprises reset of a display illumination. 
     
     
       13. The apparatus of  claim 3 , wherein the motion tracker comprises an inertial measurement unit. 
     
     
       14. The apparatus of  claim 3 , wherein the optical element comprises an array of one or more optical elements. 
     
     
       15. The apparatus of  claim 3 , wherein the compensating movement of the optical element and/or the display compensates for any one of six axis of movement: X, Y, Z, Roll, Yaw, and Pitch. 
     
     
       16. The apparatus of  claim 3 , wherein the extended reality device is configured to be mounted on a viewer's head. 
     
     
       17. The apparatus of  claim 3 , wherein actuators are arranged on the optical element and/or the display for the mechanical control. 
     
     
       18. An extended reality headset comprising the apparatus of  claim 3 .