Commodity recognition apparatus and commodity recognition method

Abstract

The commodity recognition apparatus displays a frame for surrounding a commodity in an image captured by an image capturing module. Then the commodity recognition apparatus recognizes a candidate of the commodity imaged in the frame according to the feature amount of the image in the area surrounded by the frame, and outputs information of a highest ranked candidate commodity. If a change instruction for the candidate is received, the commodity recognition apparatus outputs information of the commodity other than the highest ranked candidate selected from the candidates.

1 . (canceled) 
     
     
         2 . A commodity recognition apparatus, comprising:
 a memory configured to store computer executable instructions; and   a processor configured to execute the computer executable instruction to perform operations, the operations comprising:   displaying an image where a plurality of commodities are imaged on a display screen;   receiving an instruction input to any position on the image;   displaying a frame on the image to distinguish a commodity, which is assumed to be displayed on a position where the instruction input is received, from other commodities as a recognition subject if the instruction input is received when the frame is not displayed on the image;   displaying the frame on the image to distinguish a commodity, which is assumed to be displayed on a position where the instruction input is received, from other commodities as a recognition subject if the instruction input is received for an area outside the frame when the frame is displayed on the image;   recognizing candidates of a commodity assumed to be displayed in the frame according to feature amount of the image in an area surrounded by the frame, and outputting information of a best candidate of the commodity among the candidates; and   outputting information of a commodity other than the best candidate among candidates of a commodity, which is assumed to be displayed in the frame where the instruction input is received, if the instruction input is received for an area inside the frame when the frame is displayed on the image.   
     
     
         3 . The apparatus according to  claim 2 , wherein the operations further comprise:
 erasing a frame to which a deleting mark is given if the position on which the instruction input is received is the deleting mark given to the frame.   
     
     
         4 . The apparatus according to  claim 2 , wherein the operations further comprise:
 calculating a similarity degree between a parameter indicating appearance feature amount of each commodity and feature amount of an image in an area surrounded by the frame border for each commodity and recognizes candidates in the descending order of similarity degree; and   outputting information of the commodity having a highest similarity degree as the information of the best candidate of the commodity.   
     
     
         5 . The apparatus according to  claim 4 , wherein the operations further comprise:
 sequentially selecting a next candidate commodity of which the similarity degree is ranked just below that of the current candidate and outputting information of the selected candidate commodity every time the input instruction is received for the area inside the frame when the frame is displayed on the image.   
     
     
         6 . The apparatus according to  claim 2 , wherein the operations further comprise:
 displaying the frame having the position as a center thereof an instruction input on which is received.   
     
     
         7 . The apparatus according to  claim 2 , wherein the operations further comprise:
 outputting information of a commodity in the frame to display; and   making the display form of the frame different from the frame in which information of the commodity output is displayed.   
     
     
         8 . A commodity recognition method, comprising:
 displaying an image where a plurality of commodities are imaged on a display screen;   receiving an instruction input to any position on the image;   displaying a frame on the image to distinguish a commodity, which is assumed to be displayed on a position where the instruction input is received, from other commodities as a recognition subject if the instruction input is received when the frame is not displayed on the image;   displaying the frame on the image to distinguish a commodity, which is assumed to be displayed on a position where the instruction input is received, from other commodities as a recognition subject if the instruction input is received for an area outside the frame when the frame is displayed on the image;   recognizing candidates of a commodity assumed to be displayed in the frame according to feature amount of the image in an area surrounded by the frame, and outputting information of a best candidate of the commodity among the candidates; and   outputting information of a commodity other than the best candidate among candidates of a commodity, which is assumed to be displayed in the frame where the instruction input is received, if the instruction input is received for an area inside the frame when the frame is displayed on the image.   
     
     
         9 . The method according to  claim 8 , further comprising:
 erasing a frame to which a deleting mark is given if the position on which the instruction input is received is the deleting mark given to the frame.   
     
     
         10 . The method according to  claim 8 , further comprising:
 calculating a similarity degree between a parameter indicating appearance feature amount of each commodity and feature amount of an image in an area surrounded by the frame border for each commodity and recognizes candidates in the descending order of similarity degree; and   outputting information of the commodity having a highest similarity degree as the information of the best candidate of the commodity.   
     
     
         11 . The method according to  claim 10 , further comprising:
 sequentially selecting a next candidate commodity of which the similarity degree is ranked just below that of the current candidate and outputting information of the selected candidate commodity every time the input instruction is received for the area inside the frame when the frame is displayed on the image.   
     
     
         12 . The method according to  claim 8 , further comprising:
 displaying the frame having the position as a center thereof an instruction input on which is received.   
     
     
         13 . The method according to  claim 8 , further comprising:
 outputting information of a commodity in the frame to display; and   making the display form of the frame different from the frame in which information of the commodity output is displayed.