US2023072493A1PendingUtilityA1
Methods and Apparatus for Contrast Sensitivity Compensation
Est. expiryFeb 13, 2038(~11.6 yrs left)· nominal 20-yr term from priority
G06T 2200/24G06T 2207/20172G06T 7/90G06T 2207/20192G06T 2207/10016G06T 5/009G06T 5/73G06T 5/92
71
PatentIndex Score
0
Cited by
0
References
0
Claims
Abstract
A system and methods for contrast sensitivity compensation provides for correcting the vision of users whose vision is deficient for discerning high spatial frequencies. The system and methods use measurements of the user's contrast detection as a function of spatial frequency in the image to correct images in real time. The system includes a head-mountable device that includes a camera and a processor that can provide enhanced images at video framing rates.
Claims
exact text as granted — not AI-modified1 . A method of providing enhanced video images to a user using a programmable electronic device, the method comprising:
obtaining input video images comprising a plurality of input images A; computing, in the programmable electronic device, the application of a contrast enhancement function to the plurality of input images A to form a plurality of contrast enhanced images comprising contrast enhanced video images C where the contrast enhancement function is user-specific and where the contrast enhancement function is frequency-dependent, and presenting, on a display of the programmable electronic device and to the user, the contrast enhanced video images C, such that the contrast enhanced video images are preferentially enhanced at spatial frequencies discernable to the user.
2 . The method of claim 1 , where the contrast enhancement function depends on
a contrast sensitivity function, CSF p (u) obtained for the user p corresponding to minimum discernable contrasts to the user as a function spatial frequency u; and a spatial frequency cut-off for the user c p , where c p is the maximum spatial frequency at which the user can discern contrast.
3 . The method of claim 2 , further comprising:
obtaining the CSF p (u) and the c p from a vision test of the user.
4 . The method of claim 2 , where the contrast enhancement function further depends on
a contrast sensitivity function CSF n (u) for persons n having normal contrast sensitivity, and a spatial cut-off frequency, c n , where, c n is the maximum spatial frequency at which the user can discern contrast.
5 . The method of claim 4 ,
where each image of the plurality of input images includes a luminance image, Y(x, y) and chrominance images C B (x, y), C R (x, y), where the contrast enhancement function is
CEF
p
(
u
)
-
{
CSF
n
(
u
×
c
n
c
p
)
CSF
p
(
u
)
for
u
≤
c
p
1
for
u
>
c
p
,
where computing the application of a contrast enhancement function to the plurality of input images includes
performing a Fourier transform on the luminance image Y(x, y) to obtain a luminance amplitude M Y (u) and phase P Y (u),
enhancing the luminance amplitude by M′ Y (u)=M Y (u)×CEF P (u),
performing an inverse Fourier transform on M′ Y (u) and P Y (u) to obtain an enhanced luminance image Y′(x, y) and
the enhanced luminance image is combined with unaltered chrominance images to form contrast enhanced video images:
C=C ( x,y )=[ Y′ ( x,y ), C B ( x,y ), C R ( x,y )].
6 . A method of providing enhanced images to a user using a programmable electronic device, the method comprising:
obtaining input video images comprising a plurality of input images A, where each image of the plurality of input images includes a luminance image Y(x, y) and chrominance images C B (x, y), C R (x, y); forming a contrast enhancement function CEF p (u), as
CEF
p
(
u
)
=
{
CSF
n
(
u
×
c
n
c
p
)
CSF
p
(
u
)
for
u
≤
c
p
1
for
u
>
c
p
,
where CSF p (u), is a contrast sensitivity function for the user p corresponding to minimum discernable contrasts to the user as a function spatial frequency u,
where c p is a spatial frequency cut-off for the user, which is the maximum spatial frequency at which the user can discern contrast,
where CSF n (u) is a contrast sensitivity function for persons n having normal contrast sensitivity, and
where c n is a spatial cut-off frequency for persons n, which is the maximum spatial frequency at which the user can discern contrast;
computing, in the programmable electronic device, the application of the contrast enhancement function to the plurality of input images A to form a plurality of contrast enhanced images comprising contrast enhanced video images C where the application includes
performing a Fourier transform on the luminance image Y(x, y) to obtain a luminance amplitude M Y (u), and phase, P Y (u),
enhancing the luminance amplitude by M′ Y (u)=M Y (u)×CEF P (u),
performing an inverse Fourier transform on M′ Y (u) and P Y (u) to obtain an enhanced luminance image Y′(x, y), and
combining the enhanced luminance image is combined with unaltered chrominance images form contrast enhanced video images:
C ( x,y )=[ Y′ ( x,y ), C B ( x,y ), C R ( x,y )]; and
presenting, on a display of the programmable electronic device and to the user, the contrast enhanced video images C=C(x, y),
such that the contrast enhanced video images are preferentially enhanced at spatial frequencies discernable to the user.
7 . The method of claim 6 ,
where CSF p (u) is obtained from a measurement of the vision of the user viewing target images, where the target images each have a contrast and a spatial frequency, where CSF p (u) is a minimum discernable contrast as a function of target image spatial frequency.
8 . The method of claim 7 , further comprising:
testing the vision of the user to obtain CSF p (u).
9 . A contrast sensitivity compensation system wearable by a user, the system comprising:
a memory including a stored program; a camera mounted on the user aimed to view the scene in front of the user and operable to obtain input video images of the scene comprising a plurality of input images A; a processor programmed to execute the stored program to
compute the application of a contrast enhancement function to the plurality of input images A to form a plurality of contrast enhanced images comprising contrast enhanced video images C, where the contrast enhancement function is user-specific, and where the contrast enhancement function is frequency-dependent; and
present, to the user on a display of the programmable electronic device, the contrast enhanced video images C−C(x, y).
10 . The contrast sensitivity compensation system of claim 9 , where the contrast enhancement function depends on
a contrast sensitivity function CSF p (u) obtained for the user p corresponding to minimum discernable contrasts to the user as a function spatial frequency u and a spatial frequency cut-off for the user c p , where c p is the maximum spatial frequency at which the user can discern contrast.
11 . The contrast sensitivity compensation system of claim 10 ,
where the CSF p (u) and the c p are obtained from a vision test of the user.
12 . The contrast sensitivity compensation system of claim 10 , where the contrast enhancement function further depends on
a contrast sensitivity function CSF n (u) for persons n having normal contrast sensitivity, and a spatial cut-off frequency c n , where c n is the maximum spatial frequency at which the user can discern contrast.
13 . The contrast sensitivity compensation system of claim 12 ,
where each image of the plurality of input images includes a luminance image, Y(x, y) and chrominance images, C B (x, y), C R (x, y), where the contrast enhancement function is
CEF
p
(
u
)
=
{
CSF
n
(
u
×
c
n
c
p
)
CSF
p
(
u
)
for
u
≤
c
p
1
for
u
>
c
p
,
and where the processor is further programmed to
perform a Fourier transform on the luminance image Y(x, y) to obtain a luminance amplitude M Y (u) and phase P Y (u),
enhance the luminance amplitude by M′ Y (u)=M Y (u)×CEF P (u),
perform an inverse Fourier transform on M′ Y (u) and P Y (u) to obtain an enhanced luminance image Y′(x, y), and
combine the enhanced luminance image is combined with unaltered chrominance images form contrast enhanced video images:
C−C(x,y)−[Y′(x,y),C B (x,y),C R (x,y)].
14 . (canceled)
15 . (canceled)Join the waitlist — get patent alerts
Track US2023072493A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.