US9961257B2ActiveUtilityA1

Imaging to facilitate object gaze

58
Assignee: BEIJING ZHIGU RUITUO TECH CO LTDPriority: Sep 30, 2013Filed: Jul 2, 2014Granted: May 1, 2018
Est. expirySep 30, 2033(~7.2 yrs left)· nominal 20-yr term from priority
H04N 23/67G02B 27/017H04N 23/611H04N 23/61H04N 23/69G02B 2027/0187G02B 2027/014G02B 2027/0178H04N 5/23219G06K 9/0061G02B 27/0172G02B 27/0179H04N 5/23296G06K 9/00604G02B 2027/0138G02B 2027/0127H04N 5/23212G02B 2027/0147G06V 40/193G06V 40/19
58
PatentIndex Score
0
Cited by
24
References
32
Claims

Abstract

An imaging method includes determining a gazed object of a user according to an image at the user's eye fundus; and changing a size of a target image of the gazed object according to a predetermined zooming rule. A device comprises: an object determination unit configured to determine a gazed object of a user according to an image at the user's eye fundus; and a processing unit configured to change a size of a target image of the gazed object according to a predetermined zooming rule. The size of the target image can be changed by optical zoom processing, so that the user feels that the gazed object is observed with an appropriate size of the image at the eye fundus at an appropriate distance, thereby facilitating the user to observe the gazed object and improving the observation efficiency.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. A method, comprising:
 determining, by a system comprising a processor, a gazed object of a user according to an image at an eye fundus of the user; and 
 changing a size of a target image of the gazed object at the eye fundus according to a predetermined zooming rule. 
 
     
     
       2. The method of  claim 1 , wherein the changing the size of the target image includes:
 in a case where the user has observed the gazed object for a time period exceeding a predetermined time, changing the size of the target image of the gazed object at the eye fundus according to the predetermined zooming rule. 
 
     
     
       3. The method of  claim 1 , wherein the method also includes:
 presetting a target area ratio of the target image, and a buffer zone of the target area ratio, 
 and the changing the size of the target image includes: 
 determining an actual area ratio of the target image at the eye fundus; and 
 changing the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone. 
 
     
     
       4. The method of  claim 3 , wherein the changing the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone includes:
 in the case where the actual area ratio is smaller than the target area ratio and the actual area ratio is outside the buffer zone, zooming-in the target image to the target area ratio. 
 
     
     
       5. The method of  claim 3 , wherein the changing the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone includes:
 in the case where the actual area ratio is greater than the target area ratio and the actual area ratio is outside the buffer zone, zooming-out the target image to the target area ratio. 
 
     
     
       6. The method of  claim 3 , wherein the buffer zone is zero. 
     
     
       7. The method of  claim 1 , wherein the changing the size of the target image includes:
 determining the actual area ratio of the target image at the eye fundus; 
 determining a corresponding zooming-in factor according to the actual area ratio; and 
 changing the size of the target image according to the zooming-in factor. 
 
     
     
       8. The method of  claim 1 , wherein the changing the size of the target image includes:
 acquiring an observation distance from the gazed object to an eye of the user; 
 determining a corresponding zooming-in factor according to the observation distance; and 
 changing the size of the target image according to the zooming-in factor. 
 
     
     
       9. The method of  claim 8 , wherein the acquiring the observation distance includes:
 detecting an actual focusing point distance of the eye of the user, and taking the actual focusing point distance as the observation distance from the gazed object to the eye of the user. 
 
     
     
       10. The method of  claim 8 , wherein the acquiring the observation distance includes:
 tracking a direction of line-of-sight of the eye of the user, acquiring the scene depth of the position where the gazed object is located according to the direction of line-of-sight, and determining the observation distance from the gazed object to the eye of the user according to the scene depth. 
 
     
     
       11. The method of  claim 8 , wherein the acquiring the observation distance includes:
 tracking directions of line-of-sight of both eyes of the user, and obtaining the observation distance from the gazed object to the eye of the user via an intersection point of the directions of line-of-sight of both eyes of the user. 
 
     
     
       12. The method of  claim 1 , further comprising:
 presetting a target focusing point distance of the eye of the user, and a buffer zone of the target focusing point distance, wherein the changing the size of the target image includes: 
 detecting an actual focusing point distance of the eye of the user; and 
 changing the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone. 
 
     
     
       13. The method of  claim 12 , wherein the changing the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone includes:
 in the case where the actual focusing point distance is smaller than the target focusing point distance and the actual focusing point distance is outside the buffer zone, increasing the actual focusing point distance to the target focusing point distance. 
 
     
     
       14. The method of  claim 12 , wherein the changing the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone includes:
 in the case where the actual focusing point distance is greater than the target focusing point distance and the actual focusing point distance is outside the buffer zone, decreasing the actual focusing point distance to the target focusing point distance. 
 
     
     
       15. The method of  claim 12 , wherein the buffer zone is zero. 
     
     
       16. The method of  claim 9 , wherein the detecting the actual focusing point distance of the eye of the user includes:
 collecting images presented at the eye fundus of the user; 
 adjusting an imaging parameter of the optical path between the eye and the collection position, to collect a set of images with a definition greater than a predetermined value; 
 processing the images to obtain an optical parameter of the eye corresponding to the set of images with the definition greater than the predetermined value; and 
 obtaining the actual focusing point distance of the eye according to the optical parameter of the eye. 
 
     
     
       17. The method of  claim 16 , wherein the processing the images to obtain the optical parameter includes:
 analyzing the images to find the set of images; and 
 determining the optical parameter of the eye according to the set of images and the imaging parameter of the optical path corresponding to the set of images. 
 
     
     
       18. The method of  claim 1 , wherein the changing the size of the target image includes:
 changing the size of the target image of the gazed object at the eye fundus by optical zoom processing. 
 
     
     
       19. An imaging device, comprising:
 a processor that executes or facilitates execution of executable units to perform operations of the imaging device, the executable units comprising: 
 an object determination unit configured to determine a gazed object of a user according to an image at an eye fundus of the user; and 
 a processing unit configured to change a size of a target image of the gazed object at the eye fundus according to a predetermined zooming rule. 
 
     
     
       20. The imaging device of  claim 19 , wherein the executable units further comprise:
 a control unit configured to activate the processing unit in a case where the user has observed the gazed object for a time period exceeding a predetermined time. 
 
     
     
       21. The imaging device of  claim 19 , wherein the executable units further comprise:
 a presetting unit configured to preset a target area ratio of the target image, and a buffer zone of the target area ratio, wherein the processing unit comprises:
 a calculation subunit configured to calculate an actual area ratio of the target image at the eye fundus; and 
 an execution subunit configured to change the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone. 
 
 
     
     
       22. The imaging device of  claim 19 , wherein the processing unit comprises:
 a calculation subunit configured to calculate an actual area ratio of the target image at the eye fundus; 
 a factor subunit configured to determine a corresponding zooming-in factor according to the actual area ratio; and 
 an execution subunit configured to change the size of the target image according to the zooming-in factor. 
 
     
     
       23. The imaging device of  claim 19 , wherein the processing unit comprises:
 an acquisition subunit configured to acquire an observation distance from the gazed object to an eye of the user; 
 a factor subunit configured to determine a corresponding zooming-in factor according to the observation distance; and 
 an execution subunit configured to change the size of the target image according to the zooming-in factor. 
 
     
     
       24. The imaging device of  claim 23 , wherein the acquisition subunit comprises:
 a focusing point detection module configured to detect an actual focusing point distance of the eye of the user, and taking the actual focusing point distance as the observation distance from the gazed object to the eye of the user. 
 
     
     
       25. The imaging device of  claim 23 , wherein the acquisition subunit comprises:
 an optical axis tracking module configured to track a direction of line-of-sight of the eye of the user; 
 a depth acquisition module configured to acquire the scene depth of the position where the gazed object is located according to the direction of line-of-sight; and 
 a calculation module configured to calculate according to the scene depth to obtain the observation distance from the gazed object to the eye of the user. 
 
     
     
       26. The imaging device of  claim 23 , wherein the acquisition subunit comprises:
 an optical axis tracking module configured to track directions of line-of-sight of both eyes of the user; and 
 a distance acquisition module configured to acquire the observation distance from the gazed object to the eye of the user based on an intersection point of the directions of line-of-sight of both eyes of the user. 
 
     
     
       27. The imaging device of  claim 19 , wherein the executable units further comprise:
 a presetting unit configured to preset a target focusing point distance of an eye of the user, and a buffer zone of the target focusing point distance, wherein the processing unit comprises:
 a focusing point detection subunit configured to detect the actual focusing point distance of the eye of the user; and 
 an execution subunit configured to change the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone. 
 
 
     
     
       28. The imaging device of  claim 27 , wherein the focusing point detection subunit comprises:
 an image collection module configured to collect images presented at the eye fundus; 
 an adjustment module configured to adjust an imaging parameter of the optical path between the eye and the image collection module, to collect a set of images with a definition greater than a predetermined value; 
 an image processing module configured to process the images to obtain an optical parameter of the eye corresponding to the set of images with the definition greater than the predetermined value; and 
 a distance acquisition module configured to obtain the actual focusing point distance of the eye according to the optical parameter of the eye. 
 
     
     
       29. The imaging device of  claim 28 , wherein the image processing module comprises:
 an image analysis sub-module configured to analyze the images to find the set of images; and 
 an optical parameter calculation sub-module configured to determine the optical parameters of the eye, according to the set of images and the imaging parameter of the optical path corresponding to the set of images. 
 
     
     
       30. The imaging device of  claim 19 , wherein the device is, a pair of glasses. 
     
     
       31. A computer readable storage device, comprising at least one executable instruction, which, in response to execution, causes an imaging device comprising a processor to perform operations, comprising:
 determining a gazed object of a user according to an image at an eye fundus of the user; and 
 changing a size of a target image of the gazed object at the eye fundus according to a predefined zooming rule. 
 
     
     
       32. An imaging device, comprising a processor and a memory, the memory storing computer executable instructions, the processor being connected to the memory through a communication bus, and when the imaging device operates, the processor executing the computer executable instructions stored in the memory, so that the imaging device executes operations, comprising:
 determining a gazed object of a user according to an image at an eye fundus of the user; and 
 changing a size of a target image of the gazed object at the eye fundus according to a defined zooming rule.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.