US2023215141A1PendingUtilityA1

Methods, systems, articles of manufacture, and apparatus to classify labels based on images using artificial intelligence

Assignee: NIELSEN CONSUMER LLCPriority: Jun 30, 2020Filed: Dec 29, 2022Published: Jul 6, 2023
Est. expiryJun 30, 2040(~14 yrs left)· nominal 20-yr term from priority
G06N 3/0985G06N 3/0464G06N 3/09G06V 10/82G06V 10/25G06V 10/764G06V 10/771G06V 10/761G06V 20/70G06N 3/08G06V 10/809G06N 3/045G06F 18/2413G06F 18/254G06T 3/40G06V 2201/10G06F 18/24G06F 18/22G06F 18/251G06F 18/2163
70
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Example methods, apparatus, and articles of manufacture to classify labels based on images using artificial intelligence are disclosed. An example apparatus includes a regional proposal network to determine a first bounding box for a first region of interest in a first input image of a product; and determine a second bounding box for a second region of interest in a second input image of the product; a neural network to: generate a first classification for a first label in the first input image using the first bounding box; and generate a second classification for a second label in the second input image using the second bounding box; a comparator to determine that the first input image and the second input image correspond to a same product; and a report generator to link the first classification and the second classification to the product.

Claims

exact text as granted — not AI-modified
1 . (canceled) 
     
     
         2 . An apparatus comprising:
 interface circuitry to receive first and second images corresponding to a product;   machine readable instructions; and   programmable circuitry to execute the machine readable instructions to:
 detect a first label in the first image, the first label defined by a first bounding box; 
 classify the first label based on the first bounding box; 
 detect a second label in the second image, the second label defined by a second bounding box; 
 classify the second label based on the second bounding box; and 
 when the first classification and the second classification are associated with the product, assign the first and second classifications to the product. 
   
     
     
         3 . The apparatus of  claim 2 , wherein the first image corresponds to a first portion of the product and the second image corresponds to a second portion of the product, the first portion to be at least partially offset relative to the second portion. 
     
     
         4 . The apparatus of  claim 2 , wherein the programmable circuitry is to detect the first label by executing the machine readable instructions to:
 extract a feature map from the first image, the feature map including points; and   apply a region proposal network to the feature map to:
 generate, at respective ones of the points in the feature map, a set of anchor boxes based on predetermined anchor box sizes and anchor box ratios; 
 identify ones of the anchor boxes that include the first label based on respective objectness scores, the ones of the anchor boxes to include a respective confidence score; 
 determine bounding box coordinates for the ones of the anchor boxes, the bounding box coordinates corresponding to positions relative to the first image; and 
 identify the first bounding box as including the label by applying a non-maximum selection technique to the ones of the anchor boxes. 
   
     
     
         5 . The apparatus of  claim 4 , wherein the programmable circuitry is to execute the machine readable instructions to train the region proposal network by configuring a first hyperparameter corresponding to the predetermined anchor box ratios and a second hyperparameter corresponding to the predetermined anchor box sizes. 
     
     
         6 . The apparatus of  claim 5 , wherein the programmable circuitry is to execute the machine readable instructions to configure the first hyperparameter to anchor box ratios of (a) 1:2, (b) 1:1, and (c) 2:1. 
     
     
         7 . The apparatus of  claim 5 , wherein the programmable circuitry is to execute the machine readable instructions to configure the second hyperparameter to anchor box scales of 2, 4, and 6. 
     
     
         8 . The apparatus of  claim 2 , wherein the programmable circuitry is to execute the machine readable instructions to:
 detect a third label in the second image, the third label defined by a third bounding box;   classify the third label based on the third bounding box; and   assign the third classification to the product.   
     
     
         9 . A non-transitory machine readable storage medium comprising instructions to cause programmable circuitry to at least:
 detect a first label in a first image, the first label defined by a first bounding box, the first image to correspond to a first product;   classify the first label based on the first bounding box;   detect a second label in a second image, the second label defined by a second bounding box, the second image to correspond to the first product;   classify the second label based on the second bounding box; and   when the first classification and the second classification are associated with the product, assign the first and second classifications to the product.   
     
     
         10 . The non-transitory machine readable storage medium of  claim 9 , wherein the first image corresponds to a first region of the product and the second image corresponds to a second region of the product, the first region to be at least partially different than the second region. 
     
     
         11 . The non-transitory machine readable storage medium of  claim 9 , wherein the instructions cause the programmable circuitry to:
 extract a feature map from the first image, the feature map including points;   generate, by applying a region proposal network to the feature map, a set of anchors boxes at respective ones of the points in the feature map based on predetermined anchor box sizes and anchor box ratios;   identify ones of the anchor boxes that include the first label based on respective objectness scores, the ones of the anchor boxes to include a respective confidence score;   determine bounding box coordinates for the ones of the anchor boxes, the bounding box coordinates corresponding to positions relative to the first image; and   identify the first bounding box as including the first label by applying a non-maximum selection technique to the ones of the anchor boxes.   
     
     
         12 . The non-transitory machine readable storage medium of  claim 11 , wherein the instructions cause the programmable circuitry to train the region proposal network by configuring a first hyperparameter corresponding to the predetermined anchor box ratios and a second hyperparameter corresponding to the predetermined anchor box sizes. 
     
     
         13 . The non-transitory machine readable storage medium of  claim 12 , wherein the instructions cause the programmable circuitry to configure the first hyperparameter to anchor box ratios of (a) 1:2, (b) 1:1, and (c) 2:1. 
     
     
         14 . The non-transitory machine readable storage medium of  claim 12 , wherein the instructions cause the programmable circuitry to configure the second hyperparameter to anchor box scales of 2, 4, and 6. 
     
     
         15 . The non-transitory machine readable storage medium of  claim 9 , wherein the instructions cause the programmable circuitry to:
 detect a third label in the second image, the third label defined by a third bounding box;   classify the third label based on the third bounding box; and   assign the third classification to the product.   
     
     
         16 . An method comprising:
 detecting, by executing a machine readable instruction with programmable circuitry, a first label in a first image, the first label defined by a first bounding box, the first image corresponding to a product;   classifying, by executing a machine readable instruction with the programmable circuitry, the first label based on the first bounding box;   detecting, by executing a machine readable instruction with the programmable circuitry, a second label in a second image, the second label defined by a second bounding box the second image corresponding to the product;   classifying, by executing a machine readable instruction with the programmable circuitry, the second label based on the second bounding box; and   when the first classification and the second classification are associated with the product, assigning, by executing a machine readable instruction with the programmable circuitry, the first and second classifications to the product.   
     
     
         17 . The method of  claim 16 , wherein the first image corresponds to a first portion of the product and the second image corresponds to a second portion of the product, the second portion to be at least partially offset from the first portion of the product. 
     
     
         18 . The method of  claim 16 , wherein the detecting of the first label includes:
 extracting a feature map from the first image, the feature map including points; and   applying a region proposal network to the feature map, wherein the applying of the region proposal network to includes:
 generating, at respective ones of the points in the feature map, a set of anchors boxes based on predetermined anchor box sizes and anchor box ratios; 
 identifying ones of the anchor boxes that include the first label based on respective objectness scores, the ones of the anchor boxes to include a respective confidence score; 
 determining bounding box coordinates for the ones of the anchor boxes, the bounding box coordinates corresponding to positions relative to the first image; and 
 identifying the first bounding box as including the label by applying a non-maximum selection technique to the ones of the anchor boxes. 
   
     
     
         19 . The method of  claim 18 , further including training the region proposal network by configuring a first hyperparameter corresponding to the predetermined anchor box ratios and a second hyperparameter corresponding to the predetermined anchor box sizes. 
     
     
         20 . The method of  claim 19 , wherein the configurating of the first hyperparameter includes tuning the first hyperparameter to generate anchor box ratios of (a) 1:2, (b) 1:1, and (c) 2:1. 
     
     
         21 . The method of  claim 19 , wherein the configurating of the second hyperparameter includes tuning the second hyperparameter to generate anchor box scales of 2, 4, and 6.

Join the waitlist — get patent alerts

Track US2023215141A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.