Adaptive fingerprint-enrollment to finger characteristics using local under-display fingerprint sensor in an electronic device

Abstract

This document describes methods and systems of adaptive fingerprint-enrollment to finger characteristics using local under-display fingerprint sensors, UDFPS, in an electronic device. The electronic device includes an adaptive-enrollment module that determines characteristics of a fingerprint based on information corresponding to a touch input detected by a touch-display device, including size and shape of an area of the touch input. Based on the fingerprint characteristics, a number and location of enrollment touches used for completing enrollment of the fingerprint are adjusted to minimize the number of enrollment touches required to complete the enrollment, minimize the amount of time needed to complete the enrollment, and maximize coverage of the fingerprint. The adaptive-enrollment module also provides visual guidance to guide the user to touch the adjusted locations of the enrollment touches and, if needed, feedback to instruct the user to adjust the location of their finger to align with the visual guidance.

What is claimed is: 
     
       1. A method for adaptive fingerprint-enrollment to finger characteristics using local under-display fingerprint sensors in an electronic device, the method comprising:
 providing a first visual guide via a touch-display device and at a location corresponding to an active area of a local under-display fingerprint sensor, the active area being smaller than a typical size of a fingerprint of a user; 
 capturing a first fingerprint image of a portion of the fingerprint of a finger of the user, the user's finger touching the touch-display device at the location of the first visual guide; 
 determining a fingerprint contact region of the user's finger touching the touch-display device and, based on the fingerprint contact region, one or more characteristics corresponding to the fingerprint; 
 adjusting, based on the one or more characteristics of the fingerprint, a number of enrollment touches and target locations of the enrollment touches for enrolling the fingerprint in a fingerprint-enrollment system; 
 providing visual guidance, based on the adjusted number and target locations of the enrollment touches, to indicate a sequence of locations on the touch-display device for the user to touch with the user's finger to complete enrollment of the fingerprint with the adjusted number of enrollment touches; and 
 dynamically adjusting one or more locations of the sequence of locations based on an error calculation between one of the target locations and a detected location of a corresponding touch input on the touch-display device. 
 
     
     
       2. The method of  claim 1 , wherein the one or more characteristics of the fingerprint include one or more of size, shape, and orientation. 
     
     
       3. The method of  claim 1 , wherein the one or more characteristics of the fingerprint include an amount of pressure applied to the fingerprint contact region on the touch-display device. 
     
     
       4. The method of  claim 1 , wherein the adjusting the number of enrollment touches and the target positions of the enrollment touches includes reducing the number of enrollment touches for a smaller fingerprint or increasing the number of enrollment touches for a larger fingerprint. 
     
     
       5. The method of  claim 1 , wherein adjusting the number of enrollment touches and the target positions of enrollment touches includes reducing a total number of the enrollment touches, reducing overlap between consecutive images of the enrollment touches, increasing a non-overlapping area for each new enrollment touch, and increasing coverage of an approximated area of the fingerprint. 
     
     
       6. The method of  claim 1 , wherein adjusting the number of enrollment touches and the target positions of enrollment touches includes:
 adjusting the number of the enrollment touches to a number that results in consecutive fingerprint images having a threshold amount of overlap and achieves a total amount of coverage of the fingerprint that is within a threshold tolerance. 
 
     
     
       7. The method of  claim 1 , wherein the visual guidance includes a pattern of touch points that is adapted to the user's finger, which is represented by the one or more characteristics of the fingerprint. 
     
     
       8. The method of  claim 1 , wherein the sequence of locations forms a spiral pattern centered over the active area of the local under-display fingerprint sensor. 
     
     
       9. The method of  claim 1 , further comprising:
 determining that an image quality of a captured image of an additional portion of the fingerprint captured by the local under-display fingerprint sensor is below a quality threshold; 
 in response to determining that the image quality of the captured image is below the threshold, estimating finger pressure of the user's finger touching the touch-display device based on a heatmap of a fingerprint contact region; 
 determining that the finger pressure is below a pressure threshold; and 
 providing feedback to the user to press more firmly to increase a coupling between the user's finger and the touch-display device and increase the image quality of the image captured by the local under-display fingerprint sensor. 
 
     
     
       10. The method of  claim 1 , further comprising:
 determining a major ellipse-dimension and a minor ellipse-dimension of a fingerprint ellipse that corresponds to a fingerprint contact region; 
 constructing one or more new ellipses each having an offset from the fingerprint ellipse and being concentric with the fingerprint ellipse; 
 determining a major dimension and a minor dimension of each new ellipse; and 
 inferring, based on a size of the fingerprint ellipse, the target locations for the enrollment touches. 
 
     
     
       11. The method of  claim 10 , wherein the inferring of the target locations for the enrollment touches includes:
 determining a number of sectors for a region of each ellipse that is non-overlapping with a smaller ellipse of the one or more new ellipses; 
 correlating the target locations for the enrollment touches with the sectors in each ellipse; and 
 ordering the target locations to form the sequence of locations. 
 
     
     
       12. The method of  claim 1 , wherein the error calculation is determined based on a distance between an estimated centroid of the touch input relative to the one of the target locations. 
     
     
       13. A method for adaptive fingerprint-enrollment to finger characteristics using local under-display fingerprint sensors in an electronic device, the method comprising:
 providing a first visual guide via a touch-display device and at a location corresponding to an active area of a local under-display fingerprint sensor, the active area being smaller than a typical size of a fingerprint of a user; 
 capturing a first fingerprint image of a portion of the fingerprint of a finger of the user, the user's finger touching the touch-display device at the location of the first visual guide; 
 determining a fingerprint contact region of the user's finger touching the touch-display device and, based on the fingerprint contact region, one or more characteristics corresponding to the fingerprint; 
 adjusting, based on the one or more characteristics of the fingerprint, a number of enrollment touches and target locations of the enrollment touches for enrolling the fingerprint in a fingerprint-enrollment system; and 
 providing visual guidance, based on the adjusted number and target locations of the enrollment touches, to indicate a sequence of locations on the touch-display device for the user to touch with the user's finger to complete enrollment of the fingerprint with the adjusted number of enrollment touches, wherein each location in the sequence of locations for the enrollment touches is determined based on an estimated centroid of the fingerprint. 
 
     
     
       14. A mobile electronic device comprising:
 a touch-display device; 
 a local under-display fingerprint sensor located under the touch-display device and having an active area that is smaller than a typical size of a fingerprint of a user, the local under-display fingerprint sensor configured to capture, at a location corresponding to the active area, a fingerprint image of a portion of the fingerprint of a finger of the user when the user's finger is touching the touch-display device at the location of the active area; 
 one or more processors; and 
 memory storing instructions that, when executed by the one or more processors, cause the one or more processors to implement an adaptive-enrollment module to:
 determine one or more characteristics of the fingerprint based on the fingerprint image; 
 provide an adaptive-enrollment scheme adapted to the one or more characteristics of the fingerprint of the user during enrollment of the fingerprint, the adaptive enrollment scheme adapted based on adjusting a number of enrollment touches and target locations of the enrollment touches, based on the one or more characteristics of the fingerprint, for enrolling the fingerprint in a fingerprint-enrollment system; and 
 provide visual guidance and feedback to guide the user through a sequence of target locations for placing their finger to provide enrollment touches, the visual guidance including a first visual guide provided via the touch-display device at the location corresponding to the active area of the of the local under-display fingerprint sensor, the visual guidance provided based on the adjusted number of the enrollment touches and the adjusted target locations of the enrollment touches to indicate a sequence of locations on the touch-display device for the user to touch with the user's finger to complete enrollment of the fingerprint, one or more locations of the sequence of locations being dynamically adjustable based on an error calculation between one of the target locations and a detected location of a corresponding touch input on the touch-display device. 
 
 
     
     
       15. The mobile electronic device of  claim 14 , wherein the one or more characteristics of the fingerprint include at least one of size, shape, orientation, or an amount of pressure applied to a fingerprint contact region on the touch-display device, the fingerprint contact region corresponding to a region on the touch-display device touched by the user's finger. 
     
     
       16. The mobile electronic device of  claim 14 , wherein the adjusting the number of enrollment touches and the target positions of the enrollment touches includes reducing the number of enrollment touches for a smaller fingerprint or increasing the number of enrollment touches for a larger fingerprint. 
     
     
       17. The mobile electronic device of  claim 14 , wherein adjusting the number of enrollment touches and the target positions of enrollment touches includes reducing a total number of the enrollment touches, reducing overlap between consecutive images of the enrollment touches, increasing a non-overlapping area for each new enrollment touch, and increasing coverage of an approximated area of the fingerprint. 
     
     
       18. A computer-readable medium comprising instructions which, when executed by one or more processors, cause the one or more processors to:
 provide a first visual guide via a touch-display device and at a location corresponding to an active area of a local under-display fingerprint sensor, the active area being smaller than a typical size of a fingerprint of a user; 
 capture a first fingerprint image of a portion of the fingerprint of a finger of the user, the user's finger touching the touch-display device at the location of the first visual guide; 
 determine a fingerprint contact region of the user's finger touching the touch-display device and, based on the fingerprint contact region, one or more characteristics corresponding to the fingerprint; 
 adjust, based on the one or more characteristics of the fingerprint, a number of enrollment touches and target locations of the enrollment touches for enrolling the fingerprint in a fingerprint-enrollment system; 
 provide visual guidance, based on the adjusted number and target locations of the enrollment touches, to indicate a sequence of locations on the touch-display device for the user to touch with the user's finger to complete enrollment of the fingerprint with the adjusted number of enrollment touches; and 
 dynamically adjust one or more locations of the sequence of locations based on an error calculation between one of the target locations and a detected location of a corresponding touch input on the touch-display device. 
 
     
     
       19. The computer-readable medium of  claim 18 , wherein the instructions cause the one or more processors further to:
 determine that an image quality of a captured image of an additional portion of the fingerprint captured by the local under-display fingerprint sensor is below a quality threshold; 
 in response to determining that the image quality of the captured image is below the threshold, estimate finger pressure of the user's finger touching the touch-display device based on a heatmap of the fingerprint contact region; 
 determine that the finger pressure is below a pressure threshold; and 
 provide feedback to the user to press more firmly to increase a coupling between the user's finger and the touch-display device and increase the image quality of the image captured by the local under-display fingerprint sensor. 
 
     
     
       20. The computer-readable medium of  claim 18 , wherein the instructions cause the one or more processors further to:
 determining a major ellipse-dimension and a minor ellipse-dimension of a fingerprint ellipse that corresponds to the fingerprint contact region; 
 constructing one or more new ellipses each having an offset from the fingerprint ellipse and being concentric with the fingerprint ellipse; 
 determining a major dimension and a minor dimension of each new ellipse; and 
 inferring, based on a size of the fingerprint ellipse, the target locations for the enrollment touches.