Video processing system for identifying items in video frames

Abstract

A method and a system generate offers to a user of a mobile device based items identified in a video frame from a mobile device. A video frame selector module determines a video frame to process from the mobile device. An item identification module identifies an item in the determined video frame and tags the determined video frame with an identification of the item. Offers of the identified item from at least one merchant are generated to the mobile device.

1 . A system, comprising:
 a processor-implemented video frame selector module configured to determine a video frame to process that is received from a mobile device;   a processor-implemented item identification module configured to identify an item in the determined video frame and to tag the determined video frame with an identification of the item; and   a processor-implemented market module configured to generate offers of the identified item from at least one merchant to the mobile device.   
     
     
         2 . The system of  claim 1  further comprising:
 a processor-implemented location-based incentive module configured to offer an incentive from at least one local merchant based on the identified item and a geographic location of the mobile device. 
 
     
     
         3 . The system of  claim 1  wherein the processor-implemented video frame selector module comprises a video frame analyzer module configured to determine a difference between a first video frame and a second video frame, and a video frame tag module configured to tag the first or second video frame for item identification when the difference exceeds a predetermined amount. 
     
     
         4 . The system of  claim 1  wherein the processor-implemented item identification module comprises:
 a processor-implemented scene deconstructor module configured to deconstruct a scene in the determined video frame into a plurality of areas; 
 a processor-implemented area selector module configured to receive a user selection of an area in the determined video frame to identify the item; 
 a processor-implemented user tag module configured to receive a user input tag to help identify the item in the determined video frame; and 
 a processor-implemented image-recognition module configured to identify the item based on a comparison of an image of the item from the determined video frame with a library of item images, and to label the image of the identified item in the determined video frame. 
 
     
     
         5 . The system of  claim 4  wherein the processor implemented image-recognition module is further configured to identify the item in the corresponding area of the determined video frame. 
     
     
         6 . The system of  claim 4  wherein the processor implemented image-recognition module is further configured to identify the item in the selected area in the determined video frame. 
     
     
         7 . The system of  claim 4  wherein the processor implemented image-recognition module is further configured to determine a name of the identified item and a price of the identified item, and to label the name and price of the identified item adjacent to the image of the identified item in the determined video frame. 
     
     
         8 . The system of  claim 3  wherein the processor-implemented location-based incentive module comprises:
 a processor-implemented location identification module configured to determine the geographic location of the mobile device; and 
 a processor-implemented incentive module configured to offer an incentive from the at least one local merchant based on the identified item and the geographic location of the mobile device, wherein the incentive comprises a coupon, a discount, or a recommendation. 
 
     
     
         9 . The system of  claim 8  wherein the processor-implemented incentive module comprises:
 a processor-implemented local merchant module configured to identify the at least one local merchant with at least one incentive based on the geographic location of the mobile device; 
 a processor-implemented incentive match module configured to determine whether the item identified by the user corresponds to an item identified in the at least one incentive of the at least one local merchant; 
 a processor-implemented communication module configured to communicate the at least one incentive of the identified item from the at least one local merchant to the mobile device; and 
 a processor-implemented incentive receiver module configured to receive attributes of incentives from at least one local merchant and store the attributes of the incentives in a database, 
 wherein the attributes of the incentives for an item comprises at least one of a name attribute of the local merchant, a name attribute of the item, a brand attribute of the item, a model attribute of the item, a category tag of the item, a sub-category tag of the item, a financial promotion attribute of the item, and a financial promotion term attribute of the item. 
 
     
     
         10 . A computer-implemented method comprising:
 determining a video frame to process from a mobile device;   identifying an item in the determined video frame;   tagging the determined video frame with an identification of the item; and   generate offers of the identified item from at least one merchant to the mobile device.   
     
     
         11 . The computer-implemented method of  claim 10  further comprising:
 generating offers of the identified item from at least one merchant to the mobile device. 
 
     
     
         12 . The computer-implemented method of  claim 10  further comprising:
 offering an incentive from at least one local merchant based on the identified item and a geographic location of the mobile device. 
 
     
     
         13 . The computer-implemented method of  claim 10  wherein determining the video frame comprises:
 determining a difference between a first video frame and a second video frame; and 
 tagging the first or second video frame for item identification when the difference exceeds a predetermined amount. 
 
     
     
         14 . The computer-implemented method of  claim 10  wherein identifying the item comprises:
 deconstructing a scene in the determined video frame into a plurality of areas; 
 receiving a user selection of an area in the determined video frame to identify the item; 
 receiving a user input tag to help identify the item in the determined video frame; 
 identifying the item based on a comparison of an image of the item from the determined video frame with a library of item images; and 
 labeling the image of the identified item in the determined video frame. 
 
     
     
         15 . The computer-implemented method of  claim 14  further comprising:
 identifying the item in the corresponding area of the determined video frame. 
 
     
     
         16 . The computer-implemented method of  claim 14  further comprising:
 identifying the item in the selected area in the determined video frame. 
 
     
     
         17 . The computer-implemented method of  claim 14  further comprising:
 determining a name of the identified item and a price of the identified item; and 
 labeling the name and price of the identified item adjacent to the image of the identified item in the determined video frame. 
 
     
     
         18 . The computer-implemented method of  claim 12  further comprising:
 determining a geographic location of the mobile device; and 
 offering the incentive from the at least one local merchant based on the identified item and the geographic location of the mobile device, wherein the incentive comprises a coupon, a discount, or a recommendation. 
 
     
     
         19 . The computer-implemented method of  claim 18  further comprising:
 identifying at least one local merchant with at least one incentive based on the geographic location of the mobile device; 
 determining whether the item identified by the user corresponds to an item identified in the at least one incentive of the at least one local merchant; 
 communicating the at least one incentive of the identified item from the at least one local merchant to the mobile device; 
 receiving attributes of incentives from at least one local merchant and storing the attributes of the incentives in a database, 
 wherein the attributes of the incentives for an item comprises at least one of a name attribute of the local merchant, a name attribute of the item, a brand attribute of the item, a model attribute of the item, a category tag of the item, a sub-category tag of the item, a financial promotion attribute of the item, and a financial promotion term attribute of the item. 
 
     
     
         20 . A non-transitory computer-readable storage medium storing a set of instructions that, when executed by a processor, causes the processor to perform operations, comprising:
 determining a video frame to process from a mobile device;   identifying an item in the determined video frame;   tagging the determined video frame with an identification of the item; and   generate offers of the identified item from at least one merchant to the mobile device.   
     
     
         21 . The non-transitory computer-readable storage medium of  claim 20  further comprising:
 generating offers of the identified item from at least one merchant to the mobile device. 
 
     
     
         22 . The non-transitory computer-readable storage medium of  claim 20  further comprising:
 offering an incentive from at least one local merchant based on the identified item and a geographic location of the mobile device. 
 
     
     
         23 . The non-transitory computer-readable storage medium of  claim 20  wherein determining the video frame comprises:
 determining a difference between a first video frame and a second video frame; and 
 tagging the first or second video frame for item identification when the difference exceeds a predetermined amount. 
 
     
     
         24 . The non-transitory computer-readable storage medium of  claim 20  wherein dentifying the item comprises:
 deconstructing a scene in the determined video frame into a plurality of areas; 
 receiving a user selection of an area in the determined video frame to identify the item; 
 receiving a user input tag to help identify the item in the determined video frame; 
 identifying the item based on a comparison of an image of the item from the determined video frame with a library of item images; and 
 labeling the image of the identified item in the determined video frame. 
 
     
     
         25 . The computer-implemented method of  claim 24  further comprising:
 identifying the item in the corresponding area of the determined video frame. 
 
     
     
         26 . The computer-implemented method of  claim 24  further comprising:
 identifying the item in the selected area in the determined video frame. 
 
     
     
         27 . The computer-implemented method of  claim 24  further comprising:
 determining a name of the identified item and a price of the identified item; and 
 labeling the name and price of the identified item adjacent to the image of the identified item in the determined video frame. 
 
     
     
         28 . The computer-implemented method of  claim 20  further comprising:
 determining a geographic location of the mobile device; and 
 offering the incentive from the at least one local merchant based on the identified item and the geographic location of the mobile device, wherein the incentive comprises a coupon, a discount, or a recommendation. 
 
     
     
         29 . The computer-implemented method of  claim 28  further comprising:
 identifying at least one local merchant with at least one incentive based on the geographic location of the mobile device; 
 determining whether the item identified by the user corresponds to an item identified in the at least one incentive of the at least one local merchant; 
 communicating the at least one incentive of the identified item from the at least one local merchant to the mobile device; 
 receiving attributes of incentives from at least one local merchant and storing the attributes of the incentives in a database, 
 wherein the attributes of the incentives for an item comprises at least one of a name attribute of the local merchant, a name attribute of the item, a brand attribute of the item, a model attribute of the item, a category tag of the item, a sub-category tag of the item, a financial promotion attribute of the item, and a financial promotion term attribute of the item.