Systems and methods for auto-replenishment of products using pressure mapping sensors and machine learning

Abstract

Systems and methods for identifying, tracking usage of, and replenishing products on a shelf of a product storage unit include a pressure sensor array positioned on the shelf and configured to detect forces exerted on the pressure sensor array by each of the products located on the shelf. An electronic database stores reference pressure array data representative of a reference pressure data model relative to each of the products. A computing device obtains a pressure data set associated with a product that was captured by the pressure sensor array when the product was positioned on the pressure sensor array, and correlates the pressure data set associated with the product with the reference pressure array data stored in the electronic database to determine an identity of the product and a consumption level of the product, automatically replenishing the product when consumption of the product is above a set threshold.

What is claimed is: 
     
         1 . A system for identifying, tracking usage of, and replenishing products on a shelf of a product storage unit, the system comprising:
 a pressure sensor array positioned on the shelf and configured to detect forces exerted on the pressure sensor array by each of the products located on the shelf;   an electronic database configured to store reference pressure array data representative of a reference pressure data model relative to each of the products;
 the reference pressure data model for a selected one of the products including pressure data generated on the pressure sensor array by a reference product substantially identical to the selected one of the products when the reference product is at a plurality of consumption levels; 
 each reference pressure data model being associated in the electronic database with product identity data that identifies a product corresponding to the reference pressure data model; and 
   a computing device in communication with the pressure sensor array and the electronic database, the computing device including a processor-based control circuit configured to:
 obtain a pressure data set associated with the selected one of the products and captured by the pressure sensor array when the selected one of the products was positioned on the pressure sensor array; 
 correlate the pressure data set associated with the selected one of the products with the reference pressure array data stored in the electronic database to determine whether the reference pressure array data stored in the electronic database includes a reference pressure data model that matches the pressure data set associated with the selected one of the products; and 
 if a correlation of the pressure data set associated with the selected one of the products with the reference pressure array data stored in the electronic database indicates a match between the pressure data set associated with the selected one of the products and one of the reference pressure data models stored in the electronic database:
 obtain the product identity data stored in the electronic database in association with the one of the reference pressure data models that matches the pressure data set associated with the selected one of the products; and 
 determine an identity of the selected one of the products based on the product identity data obtained from the electronic database. 
 
   
     
     
         2 . The system of  claim 1 , wherein the product-storing unit comprises a refrigerator, a freezer, a cabinet, a cupboard, a pantry, and a shelving structure. 
     
     
         3 . The system of  claim 1 , wherein the electronic database further comprises electronic data representative of: pressure data sets previously obtained by the pressure sensor array, identity of the products on or likely to be on the shelf, relative orientation of the products on the shelf, price of the products, unit weight of each of the products, unit volume of each of the products, sensor configuration, relative sensor location, and unit quantity of each of the products. 
     
     
         4 . The system of  claim 1 , wherein, based one or more pressure data sets obtained by the computing device from the pressure sensor array, the control circuit of the computing device is configured to determine that:
 the selected one of the products is no longer positioned on the pressure sensor array; or   the selected one of the products was moved to a different location on the pressure sensor array.   
     
     
         5 . The system of  claim 1 , wherein, based on a determination of the identity of the selected one of the products by the control circuit of the computing device, the control circuit is programmed to correlate the pressure data set associated with the selected one of the products with the reference pressure array data stored in the electronic database that matches the selected one of the products to determine a level of consumption of the selected one of the products. 
     
     
         6 . The system of  claim 5 ,
 wherein the electronic database further comprises product replenishment threshold settings associated with a user; and   wherein the control circuit of the computing device is configured, in response to a determination, by the computing device, that the level of consumption of the selected one of the products is above the product replenishment threshold, to:
 automatically process a replenishment order for the selected one of the products for delivery to the user; and 
 cause transmission of an electronic notification to an electronic device of the user, the electronic notification including a confirmation that the replenishment order was processed. 
   
     
     
         7 . The system of  claim 6 ,
 wherein the electronic database further comprises a minimum total dollar amount threshold for triggering a delivery of the replenishment order; and   wherein the control circuit of the computing device is configured to:
 automatically process the replenishment order for the selected one of the products in response to a determination, by the computing device, that the minimum total dollar amount threshold is exceeded; and 
 in response to a determination, by the computing device, that the minimum total dollar amount threshold is not exceeded, delay processing the replenishment order for the selected one of the products until products are added to the replenishment order such that the minimum total dollar amount threshold of the replenishment order is exceeded. 
   
     
     
         8 . The system of  claim 5 ,
 wherein the electronic database further comprises product replenishment threshold settings associated with a user; and   wherein the control circuit of the computing device is configured, in response to a determination, by the computing device, that the level of consumption of the selected one of the products is above the product replenishment threshold, to:
 generate a proposed replenishment order for the selected one of the products for delivery to the user; and 
 cause transmission of an electronic notification to an electronic device of the user, the electronic notification being configured to generate a virtual shopping cart on the electronic device, the virtual shopping cart being configured to permit the user of the electronic device to accept, decline, or modify the proposed replenishment order generated by the control circuit. 
   
     
     
         9 . The system of  claim 1 ,
 wherein the control circuit of the computing device is configured to process the pressure data set associated with the selected one of the products and captured by the pressure sensor array when the selected one of the products was positioned on the pressure sensor array by generating a boxed data set, where a virtual bounding box extends around the pressure data set, such that the pressure data set obtained by the computing device for each the products is bounded within a respective virtual bounding box; and   wherein, after the control circuit of the computing device determines the identity of the selected one of the products, the control circuit of the computing device is configured to transmit a signal including the boxed data set to the electronic database to update the electronic database, such that the boxed data set is associated in the electronic database with the product identity data corresponding to the selected one of the products the identity of which was determined.   
     
     
         10 . The system of  claim 9 , wherein the correlation by the computing device is performed via machine learning model, wherein the machine learning model is trained using the reference pressure sensor array data stored in the electronic database in association with the selected one of the products. 
     
     
         11 . A method for identifying, tracking usage of, and replenishing products on a shelf of a product storage unit, the method comprising:
 providing a pressure sensor array positioned on the shelf and configured to detect a force exerted on the pressure sensor array by each of the products located on the shelf;   providing an electronic database configured to store reference pressure array data representative of a reference pressure data model relative to each of the products;
 the reference pressure data model for a selected one of the products including pressure data generated on the pressure sensor array by a reference product substantially identical to the selected one of the products when the reference product is at a plurality of consumption levels; 
 each reference pressure data model being associated in the electronic database with product identity data that identifies a product corresponding to the reference pressure data model; and 
   providing a computing device including a processor-based control circuit in communication with the pressure sensor array and the electronic database;   obtaining, by the computing device, a pressure data set associated with the selected one of the products and captured by the pressure sensor array when the selected one of the products was positioned on the pressure sensor array;   correlating the pressure data set associated with the selected one of the products with the reference pressure array data stored in the electronic database to determine whether the reference pressure array data stored in the electronic database includes a reference pressure data model that matches the pressure data set associated with the selected one of the products; and   if a correlation of the pressure data set associated with the selected one of the products with the reference pressure array data stored in the electronic database indicates a match between the pressure data set associated with the selected one of the products and one of the reference pressure data models stored in the electronic database, by the control circuit of the computing device:
 obtaining the product identity data stored in the electronic database in association with the one of the reference pressure data models that matches the pressure data set associated with the selected one of the products; and 
 determining an identity of the selected one of the products based on the product identity data and product location data obtained from the electronic database. 
   
     
     
         12 . The method of  claim 11 , wherein the product-storing unit comprises a refrigerator, a freezer, a cabinet, a cupboard, a pantry, and a shelving structure. 
     
     
         13 . The method of  claim 11 , wherein the electronic database further comprises electronic data representative of: pressure data sets previously obtained by the pressure sensor array, identity of the products on or likely to be on the shelf, relative orientation of the products on the shelf, price of the products, unit weight of each of the products, unit volume of each of the products, sensor configuration, relative sensor location, and unit quantity of each of the products. 
     
     
         14 . The method of  claim 11 , wherein, based one or more pressure data sets obtained by the computing device from the pressure sensor array, determining, by the control circuit of the computing device that:
 the selected one of the products is no longer positioned on the pressure sensor array; or   the selected one of the products was moved to a different location on the pressure sensor array.   
     
     
         15 . The method of  claim 11 , further comprising, based on a determination of the identity of the selected one of the products by the control circuit of the computing device, correlating, via the control circuit of the computing device, the pressure data set associated with the selected one of the products with the reference pressure array data stored in the electronic database that matches the selected one of the products to determine a level of consumption of the selected one of the products relative to a unit of the selected one of the products when unopened or unconsumed. 
     
     
         16 . The method of  claim 15 ,
 wherein the electronic database further comprises product replenishment threshold settings associated with a user; and   in response to a determination, by the computing device, that the level of consumption of the selected one of the products is above the product replenishment threshold, by the control circuit of the computing device:   automatically processing a replenishment order for the selected one of the products for delivery to the user; and   causing transmission of an electronic notification to an electronic device of the user, the electronic notification including a confirmation that the replenishment order was processed.   
     
     
         17 . The method of  claim 16 ,
 wherein the electronic database further comprises a minimum total dollar amount threshold for triggering a delivery of the replenishment order; and   further comprising, by the control circuit of the computing device:   automatically processing the replenishment order for the selected one of the products in response to a determination, by the computing device, that the minimum total dollar amount threshold is exceeded; and   in response to a determination, by the computing device, that the minimum total dollar amount threshold is not exceeded, delaying processing the replenishment order for the selected one of the products until products are added to the replenishment order such that the minimum total dollar amount threshold of the replenishment order is exceeded.   
     
     
         18 . The method of  claim 15 ,
 wherein the electronic database further comprises product replenishment threshold settings associated with a user; and   further comprising, by the control circuit of the computing device and in response to a determination, by the computing device, that the level of consumption of the selected one of the products is above the product replenishment threshold:   generating a proposed replenishment order for the selected one of the products for delivery to the user; and   causing transmission of an electronic notification to an electronic device of a user, the electronic notification being configured to generate a virtual shopping cart on the electronic device, the virtual shopping cart being configured to permit the user of the electronic device to accept, decline, or modify the proposed replenishment order generated by the control circuit.   
     
     
         19 . The method of  claim 11 , further comprising:
 processing, via the control circuit of the computing device, the pressure data set associated with the selected one of the products and captured by the pressure sensor array when the selected one of the products was positioned on the pressure sensor array by generating a boxed data set, where a virtual bounding box extends around the pressure data set, such that the pressure data set obtained by the computing device for each the products is bounded within a respective virtual bounding box; and   after the control circuit of the computing device determines the identity of the selected one of the products, transmitting, via the control circuit of the computing device, a signal including the boxed data set to the electronic database to update the electronic database, such that the boxed data set is associated in the electronic database with the product identity data corresponding to the selected one of the products the identity of which was determined.   
     
     
         20 . The method of  claim 11 , wherein the correlation by the computing device is performed via machine learning model, wherein the machine learning model is trained using the reference pressure sensor array data stored in the electronic database in association with the selected one of the products.