US2023025548A1PendingUtilityA1

Systems and methods for recognizing text of interest

Assignee: WALMART APOLLO LLCPriority: Jul 20, 2021Filed: Jul 20, 2021Published: Jan 26, 2023
Est. expiryJul 20, 2041(~15 yrs left)· nominal 20-yr term from priority
G06K 9/46G06K 9/325G06T 11/60G06K 2209/01G06K 9/6218G06V 2201/08G06V 20/63G06V 10/82G06V 30/18G06V 20/62G06F 18/23
58
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

In some embodiments, apparatuses and methods are provided herein useful to determine text on an object. In some embodiments, there is provided a system to determine text of interest on an object of interest including at least one camera and a control circuit configured to execute a machine learning model trained to identify the text of interest, group into a cluster each node point that is located substantially in the same location in the text of interest, determine a score value of each particular character in the cluster, identify the particular character that has a determined score value corresponding to at least a threshold score value relative to all characters in the cluster, assign the particular character having the determined score value corresponding to at least the threshold score value as a recognized character in the cluster, and transmit to a display monitor overlay data.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A pattern agnostic optical character recognition (OCR) system for determining text of interest on an object of interest, the system comprising:
 at least one camera configured to capture one or more digital images of the object of interest; and   a control circuit configured to execute a machine learning model trained to:
 identify the text of interest on the object of interest in each digital image of the captured one or more digital images, wherein the text of interest comprises one or more characters to be identified, and wherein each character in the text of interest corresponds to a node point; 
 group into a cluster each node point that is located substantially in the same location in the text of interest identified in each of the captured one or more digital images; 
 determine a score value of each particular character in the cluster based on a weighted sum of a number of occurrences of the particular character in the cluster relative to a total sum of occurrences of all characters in the cluster and an average confidence value associated with the particular character; 
 identify the particular character that has a determined score value corresponding to at least a threshold score value relative to all characters in the cluster; 
 assign the particular character having the determined score value corresponding to at least the threshold score value as a recognized character in the cluster; and 
 transmit to a display monitor overlay data comprising each recognized character associated with each cluster in the text of interest to cause the display monitor to display the transmitted overlay data with the captured one or more digital images. 
   
     
     
         2 . The pattern agnostic OCR system of  claim 1 , wherein the object comprises a cargo trailer for use in distribution of goods, the text of interest identifying the cargo trailer. 
     
     
         3 . The pattern agnostic OCR system of  claim 1 , wherein the text of interest comprises a corresponding identification associated with the object. 
     
     
         4 . The pattern agnostic OCR system of  claim 1 , wherein the character comprises a letter, a symbol of an alphabet, and a number. 
     
     
         5 . The pattern agnostic OCR system of  claim 1 , wherein each character in the text of interest is vertically aligned relative to other characters in the text of interest. 
     
     
         6 . The pattern agnostic OCR system of  claim 5 , wherein the cluster comprises at least five node points to be grouped into the cluster. 
     
     
         7 . The pattern agnostic OCR system of  claim 1 , wherein each character in the text of interest is horizontally aligned relative to other characters in the text of interest. 
     
     
         8 . The pattern agnostic OCR system of  claim 7 , wherein the cluster comprises at least four node points to be grouped into the cluster. 
     
     
         9 . The pattern agnostic OCR system of  claim 1 , wherein the control circuit is further configured to determine that a plurality of node points are located substantially in the same location in the text of interest of the captured one or more digital images, and wherein the plurality of node points are grouped into the cluster when each node point of the plurality of node points is not more than seven unit distance from other node points in the plurality of node points. 
     
     
         10 . The pattern agnostic OCR system of  claim 9 , wherein the control circuit is further configured to:
 determine that a plurality of clusters are located substantially in the same location in the text of interest of the captured one or more digital images; and   merge two or more clusters of the plurality of clusters based on a unit distance between each cluster of the two or more clusters being less than a threshold merging value.   
     
     
         11 . The pattern agnostic OCR system of  claim 10 , wherein the threshold merging value is based on a ratio between a predetermined constant value associated with a total number of clusters associated with the text of interest and an average cluster distance between each cluster of the two or more clusters. 
     
     
         12 . The pattern agnostic OCR system of  claim 1 , further comprising a database configured to store a plurality of threshold merging values, each threshold merging value is associated with a possible total number of clusters in the text of interest and usable when a plurality of node points are located substantially in the same location in the text of interest. 
     
     
         13 . The pattern agnostic OCR system of  claim 1 , wherein the threshold score value corresponds to a highest score value relative to determined score values of all characters in the cluster. 
     
     
         14 . A method for pattern agnostic optical character recognition (OCR) for determining text of interest on an object of interest, the method comprising:
 capturing, by at least one camera, one or more digital images of an object;   identifying, by a control circuit, text of interest on the object in each digital image of the captured one or more digital images, wherein the text of interest comprises one or more characters to be identified, and wherein each character in the text of interest corresponds to a node point;   grouping, by the control circuit, into a cluster each node point that is located substantially in the same location in the text of interest identified in each of the captured one or more digital images;   determining, by the control circuit, a score value of each particular character in the cluster based on a weighted sum of a number of occurrences of the particular character in the cluster relative to a total sum of occurrences of all characters in the cluster and an average confidence value associated with the particular character;   identifying, by the control circuit, the particular character that has a determined score value corresponding to at least a threshold score value relative to all characters in the cluster;   assigning, by the control circuit, the particular character having the determined score value corresponding to at least the threshold score value as a recognized character in the cluster;   transmitting, by the control circuit, to a display monitor overlay data comprising each recognized character associated with each cluster in the text of interest to cause the display monitor to display the transmitted overlay data with the captured one or more digital images.   
     
     
         15 . The method of  claim 14 , wherein the object comprises a cargo trailer for use in distribution of goods, the text of interest identifying the cargo trailer. 
     
     
         16 . The method of  claim 14 , wherein the text of interest comprises a corresponding identification associated with the object. 
     
     
         17 . The method of  claim 14 , wherein the character comprises a letter, a symbol of an alphabet, and a number. 
     
     
         18 . The method of  claim 14 , wherein each character in the text of interest is vertically aligned relative to other characters in the text of interest. 
     
     
         19 . The method of  claim 18 , wherein the cluster comprises at least five node points to be grouped into the cluster. 
     
     
         20 . The method of  claim 14 , wherein each character in the text of interest is horizontally aligned relative to other characters in the text of interest. 
     
     
         21 . The method of  claim 20 , wherein the cluster comprises at least four node points to be grouped into the cluster. 
     
     
         22 . The method of  claim 14 , further comprising determining, by the control circuit, that a plurality of node points are located substantially in the same location in the text of interest of the one or more images, wherein the plurality of node points are grouped into the cluster when each node point of the plurality of node points is not more than seven unit distance from other node points in the plurality of node points. 
     
     
         23 . The method of  claim 22 , further comprising:
 determining, by the control circuit, that a plurality of clusters are located substantially in the same location in the text of interest of the one or more images; and   merging, by the control circuit, two or more clusters of the plurality of clusters based on a unit distance between each cluster of the two or more clusters being less than a threshold merging value.   
     
     
         24 . The method of  claim 23 , wherein the threshold merging value is based on a ratio between a predetermined constant value associated with a total number of clusters associated with the text of interest and an average cluster distance between each cluster of the two or more clusters. 
     
     
         25 . The method of  claim 14 , further comprising storing, at a database, a plurality of threshold merging values, each threshold merging value is associated with a possible total number of clusters in the text of interest and usable when a plurality of node points are located substantially in the same location in the text of interest. 
     
     
         26 . The method of  claim 14 , wherein the threshold score value corresponds to a highest score value relative to determined score values of all characters in the cluster.

Join the waitlist — get patent alerts

Track US2023025548A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.