Methods, systems, articles of manufacture, and apparatus to classify labels based on images using artificial intelligence
Abstract
Example methods, apparatus, and articles of manufacture to classify labels based on images using artificial intelligence are disclosed. An example apparatus includes a regional proposal network to determine a first bounding box for a first region of interest in a first input image of a product; and determine a second bounding box for a second region of interest in a second input image of the product; a neural network to: generate a first classification for a first label in the first input image using the first bounding box; and generate a second classification for a second label in the second input image using the second bounding box; a comparator to determine that the first input image and the second input image correspond to a same product; and a report generator to link the first classification and the second classification to the product.
Claims
exact text as granted — not AI-modified1 . (canceled)
2 . An apparatus comprising:
interface circuitry to receive first and second images corresponding to a product; machine readable instructions; and programmable circuitry to execute the machine readable instructions to:
detect a first label in the first image, the first label defined by a first bounding box;
classify the first label based on the first bounding box;
detect a second label in the second image, the second label defined by a second bounding box;
classify the second label based on the second bounding box; and
when the first classification and the second classification are associated with the product, assign the first and second classifications to the product.
3 . The apparatus of claim 2 , wherein the first image corresponds to a first portion of the product and the second image corresponds to a second portion of the product, the first portion to be at least partially offset relative to the second portion.
4 . The apparatus of claim 2 , wherein the programmable circuitry is to detect the first label by executing the machine readable instructions to:
extract a feature map from the first image, the feature map including points; and apply a region proposal network to the feature map to:
generate, at respective ones of the points in the feature map, a set of anchor boxes based on predetermined anchor box sizes and anchor box ratios;
identify ones of the anchor boxes that include the first label based on respective objectness scores, the ones of the anchor boxes to include a respective confidence score;
determine bounding box coordinates for the ones of the anchor boxes, the bounding box coordinates corresponding to positions relative to the first image; and
identify the first bounding box as including the label by applying a non-maximum selection technique to the ones of the anchor boxes.
5 . The apparatus of claim 4 , wherein the programmable circuitry is to execute the machine readable instructions to train the region proposal network by configuring a first hyperparameter corresponding to the predetermined anchor box ratios and a second hyperparameter corresponding to the predetermined anchor box sizes.
6 . The apparatus of claim 5 , wherein the programmable circuitry is to execute the machine readable instructions to configure the first hyperparameter to anchor box ratios of (a) 1:2, (b) 1:1, and (c) 2:1.
7 . The apparatus of claim 5 , wherein the programmable circuitry is to execute the machine readable instructions to configure the second hyperparameter to anchor box scales of 2, 4, and 6.
8 . The apparatus of claim 2 , wherein the programmable circuitry is to execute the machine readable instructions to:
detect a third label in the second image, the third label defined by a third bounding box; classify the third label based on the third bounding box; and assign the third classification to the product.
9 . A non-transitory machine readable storage medium comprising instructions to cause programmable circuitry to at least:
detect a first label in a first image, the first label defined by a first bounding box, the first image to correspond to a first product; classify the first label based on the first bounding box; detect a second label in a second image, the second label defined by a second bounding box, the second image to correspond to the first product; classify the second label based on the second bounding box; and when the first classification and the second classification are associated with the product, assign the first and second classifications to the product.
10 . The non-transitory machine readable storage medium of claim 9 , wherein the first image corresponds to a first region of the product and the second image corresponds to a second region of the product, the first region to be at least partially different than the second region.
11 . The non-transitory machine readable storage medium of claim 9 , wherein the instructions cause the programmable circuitry to:
extract a feature map from the first image, the feature map including points; generate, by applying a region proposal network to the feature map, a set of anchors boxes at respective ones of the points in the feature map based on predetermined anchor box sizes and anchor box ratios; identify ones of the anchor boxes that include the first label based on respective objectness scores, the ones of the anchor boxes to include a respective confidence score; determine bounding box coordinates for the ones of the anchor boxes, the bounding box coordinates corresponding to positions relative to the first image; and identify the first bounding box as including the first label by applying a non-maximum selection technique to the ones of the anchor boxes.
12 . The non-transitory machine readable storage medium of claim 11 , wherein the instructions cause the programmable circuitry to train the region proposal network by configuring a first hyperparameter corresponding to the predetermined anchor box ratios and a second hyperparameter corresponding to the predetermined anchor box sizes.
13 . The non-transitory machine readable storage medium of claim 12 , wherein the instructions cause the programmable circuitry to configure the first hyperparameter to anchor box ratios of (a) 1:2, (b) 1:1, and (c) 2:1.
14 . The non-transitory machine readable storage medium of claim 12 , wherein the instructions cause the programmable circuitry to configure the second hyperparameter to anchor box scales of 2, 4, and 6.
15 . The non-transitory machine readable storage medium of claim 9 , wherein the instructions cause the programmable circuitry to:
detect a third label in the second image, the third label defined by a third bounding box; classify the third label based on the third bounding box; and assign the third classification to the product.
16 . An method comprising:
detecting, by executing a machine readable instruction with programmable circuitry, a first label in a first image, the first label defined by a first bounding box, the first image corresponding to a product; classifying, by executing a machine readable instruction with the programmable circuitry, the first label based on the first bounding box; detecting, by executing a machine readable instruction with the programmable circuitry, a second label in a second image, the second label defined by a second bounding box the second image corresponding to the product; classifying, by executing a machine readable instruction with the programmable circuitry, the second label based on the second bounding box; and when the first classification and the second classification are associated with the product, assigning, by executing a machine readable instruction with the programmable circuitry, the first and second classifications to the product.
17 . The method of claim 16 , wherein the first image corresponds to a first portion of the product and the second image corresponds to a second portion of the product, the second portion to be at least partially offset from the first portion of the product.
18 . The method of claim 16 , wherein the detecting of the first label includes:
extracting a feature map from the first image, the feature map including points; and applying a region proposal network to the feature map, wherein the applying of the region proposal network to includes:
generating, at respective ones of the points in the feature map, a set of anchors boxes based on predetermined anchor box sizes and anchor box ratios;
identifying ones of the anchor boxes that include the first label based on respective objectness scores, the ones of the anchor boxes to include a respective confidence score;
determining bounding box coordinates for the ones of the anchor boxes, the bounding box coordinates corresponding to positions relative to the first image; and
identifying the first bounding box as including the label by applying a non-maximum selection technique to the ones of the anchor boxes.
19 . The method of claim 18 , further including training the region proposal network by configuring a first hyperparameter corresponding to the predetermined anchor box ratios and a second hyperparameter corresponding to the predetermined anchor box sizes.
20 . The method of claim 19 , wherein the configurating of the first hyperparameter includes tuning the first hyperparameter to generate anchor box ratios of (a) 1:2, (b) 1:1, and (c) 2:1.
21 . The method of claim 19 , wherein the configurating of the second hyperparameter includes tuning the second hyperparameter to generate anchor box scales of 2, 4, and 6.Join the waitlist — get patent alerts
Track US2023215141A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.