Virtual rigid framework for sensor subsystem

Abstract

An apparatus for dynamically determining a displacement of a target sensor in an electronic system is disclosed. The apparatus can comprise a non-line-of-sight sensor rigidly mounted on or proximate to the target sensor and configured to measure a parameter that varies with the displacement of the target sensor. The apparatus further can comprise at least one processor coupled to the non-line-of-sight sensor and configured to compute the displacement of the target sensor based on the parameter, and to compute an adjustment value based on the computed displacement.

What is claimed is: 
     
       1. A near-to-eye display (NED) device comprising:
 a display subsystem to generate an image and to direct light representing the image to an eye of a user; 
 a target sensor coupled to the display subsystem; 
 a second sensor mounted on or proximate to the target sensor to measure a parameter that varies with a displacement of the target sensor, wherein the second sensor is a magnetic field sensor comprising a coil mounted to a lens barrel of the target sensor; and 
 a processor coupled to the second sensor and configured to compute the displacement of the target sensor based on the parameter. 
 
     
     
       2. The NED device of  claim 1 , wherein the processor is further configured to compute an adjustment value based on the computed displacement. 
     
     
       3. The NED device of  claim 2 , wherein the display subsystem is configured to display the image based on the adjustment value. 
     
     
       4. The NED device of  claim 1 , wherein the target sensor is a camera. 
     
     
       5. The NED device of  claim 1 , wherein the magnetic field sensor comprises a coil that encircles a lens barrel of the target sensor. 
     
     
       6. The NED device of  claim 1 , further comprising:
 a transmitter to transmit a non-line-of-sight signal detectable by the second sensor. 
 
     
     
       7. The NED device of  claim 6 , wherein the transmitter comprises a magnetic field generator. 
     
     
       8. The NED device of  claim 6 , further comprising an inertial measurement unit rigidly coupled to the transmitter and configured to measure an orientation of the transmitter. 
     
     
       9. The NED device of  claim 8 , wherein the processor is configured to further compute the displacement of the target sensor based on the orientation of the transmitter, and to compute an adjustment value based on the computed displacement, and wherein the display subsystem is further configured to display the image based on the adjustment value. 
     
     
       10. The NED device of  claim 1 , further comprising:
 a third sensor and a fourth sensor, each mounted on or proximate to the target sensor to measure the parameter; 
 wherein the processor is configured to compute the displacement of the target sensor and an orientation of the target sensor in six degrees of freedom, based on outputs of the second, third and fourth sensors. 
 
     
     
       11. The NED device of  claim 1 , wherein the parameter comprises at least one of a magnetic field strength or a magnetic field direction. 
     
     
       12. An apparatus for dynamically determining a displacement of a target sensor in an electronic system, the apparatus comprising:
 a non-line-of-sight sensor rigidly mounted on or proximate to the target sensor and configured to measure a parameter that varies with the displacement of the target sensor, wherein the non-line-of-sight sensor is a magnetic field sensor comprising a coil mounted to a lens barrel of the target sensor; and 
 at least one processor coupled to the non-line-of-sight sensor and configured to compute the displacement of the target sensor based on the parameter, and to compute an adjustment value based on the computed displacement. 
 
     
     
       13. The apparatus of  claim 12 , wherein the target sensor is a camera. 
     
     
       14. The apparatus of  claim 13 , wherein the apparatus is a near-to-eye display (NED) device. 
     
     
       15. The apparatus of  claim 12 , further comprising:
 a transmitter to transmit a non-line-of-sight signal detectable by the the non-line-of-sight sensor. 
 
     
     
       16. The apparatus of  claim 15 , wherein the transmitter comprises a magnetic field generator. 
     
     
       17. The apparatus of  claim 15 , further comprising an inertial measurement unit rigidly coupled to the transmitter and configured to measure an orientation of the transmitter. 
     
     
       18. The apparatus of  claim 17 , wherein the at least one processor is configured to further compute the displacement and the adjustment value based on the orientation of the transmitter, and further comprising a display subsystem configured to display an image based on the adjustment value. 
     
     
       19. The apparatus of  claim 12 , further comprising:
 a third sensor and a fourth sensor, each mounted on or proximate to the target sensor to measure the parameter; 
 wherein the processor is configured to compute the displacement of the target sensor and an orientation of the target sensor in six degrees of freedom, based on outputs of the the non-line-of-sight sensor, the third sensor, and the fourth sensor. 
 
     
     
       20. The apparatus of  claim 12 , wherein the parameter comprises at least one of a magnetic field strength or a magnetic field direction. 
     
     
       21. The apparatus of  claim 12 , further comprising a display subsystem configured to display an image based on the adjustment value. 
     
     
       22. A method of operation of a near-to-eye display (NED) device, the method comprising:
 generating an image for display to a user of the NED device; 
 acquiring data from a camera on the NED device; 
 using a magnetic field sensor mounted on or proximate to the camera to measure a parameter that varies with a displacement of the camera, wherein the magnetic field sensor comprises a coil mounted to a lens barrel of the camera; and 
 computing the displacement of the camera based on the parameter as indicated in an output of the magnetic field sensor. 
 
     
     
       23. The method of  claim 22 , further comprising:
 computing an adjustment value based on the computed displacement; and 
 displaying the image based on the adjustment value. 
 
     
     
       24. The method of  claim 22 , wherein the parameter comprises at least one of a magnetic field strength or a magnetic field direction. 
     
     
       25. The method of  claim 22 , further comprising:
 transmitting, by a transmitter, a non-line-of-sight signal detectable by the magnetic field sensor; and 
 measuring, by an inertial measurement unit rigidly coupled to the transmitter, an orientation of the transmitter. 
 
     
     
       26. The method of  claim 25 , wherein computing the displacement of the camera is further based on the orientation of the transmitter, and further comprising computing an adjustment value based on the computed displacement, and displaying the image based on the adjustment value.