Display rack image processing device, image processing method, and recording medium

Abstract

A state of a display rack is evaluated accurately. An image processing device includes a detection unit configured to detect a change area related to a display rack from a captured image in which an image of the display rack is captured, a classification unit configured to classify a change related to the display rack in the change area, and an evaluation unit configured to evaluate a display state of goods, based on a classification result.

What is claimed is: 
     
       1. An image processing device comprising a processor configured to:
 detect a change area related to a display rack from a captured image in which an image of the display rack is captured; 
 classify a change related to the display rack in the change area; and 
 evaluate a display state of goods, based on a classification result, wherein 
 the captured image is a color image, 
 the processor detects the change area by comparing the captured image with background information indicating the image captured before the image capturing time of the captured image, and 
 the processor classifies the change related to the display rack in the change area, based on a previously learned model of the change related to the display rack. 
 
     
     
       2. The image processing device according to  claim 1 , wherein
 the processor calculates an amount of display of the goods, based on the classification result, information about the change area, and monitored area information indicating a target area where the display state of the goods is monitored in the captured image. 
 
     
     
       3. The image processing device according to  claim 2 , wherein
 the processor evaluates the display state of the goods, based on a transition of the amount of display over time. 
 
     
     
       4. The image processing device according to  claim 1 , the processor further configured to
 output information about the display state of the goods to an output device, based on an evaluation result. 
 
     
     
       5. The image processing device according to  claim 1 , wherein
 the processor tracks the change area between a plurality of the captured images, and 
 the processor classifies the change related to the display rack, based on a tracking result. 
 
     
     
       6. The image processing device according to  claim 5 , wherein
 the processor updates the background information, based on the captured image used when detecting the change area, and the background information, and, 
 when the tracking result of the change area satisfies a first predetermined condition, the processor updates an area other than an area corresponding to the change area, in the background information. 
 
     
     
       7. The image processing device according to  claim 6 , wherein,
 when the tracking result of the change area satisfies a second predetermined condition, the processor updates the area corresponding to the change area, in the background information. 
 
     
     
       8. The image processing device according to  claim 1 , wherein,
 based on the change area and rack area information indicating a rack area where the goods is displayed in the display rack, the processor determines whether or not the change area is included in a plurality of the rack areas, and, 
 when the change area is included in one of the rack areas, the processor classifies the change related to the display rack in the change area as a type related to a change in goods displayed on the display rack. 
 
     
     
       9. An image processing method comprising:
 detecting a change area related to a display rack from a captured image in which an image of the display rack is captured; 
 classifying a change related to the display rack in the change area; and 
 evaluating a display state of goods, based on a classification result, wherein 
 the captured image is a color image, 
 the detecting comprises detecting the change area by comparing the captured image with background information indicating the image captured before the image capturing time of the captured image, and 
 the classifying comprises classifying the change related to the display rack in the change area, based on a previously learned model of the change related to the display rack. 
 
     
     
       10. The image processing method according to  claim 9 , further comprising
 calculating an amount of display of goods, based on the classification result, information about the change area, and monitored area information indicating a target area where a display state of goods is monitored in the captured image. 
 
     
     
       11. A computer-readable non-transitory recording medium recorded with a program causing a computer to execute:
 detection processing of detecting a change area related to a display rack from a captured image in which an image of the display rack is captured; 
 classification processing of classifying a change related to the display rack in the change area; and 
 evaluation processing of evaluating a display state of goods, based on a classification result, wherein 
 the captured image is a color image, 
 the detection processing of detecting the change area by comparing the captured image with background information indicating the image captured before the image capturing time of the captured image, and 
 the classification processing of classifying the change related to the display rack in the change area, based on a previously learned model of the change related to the display rack. 
 
     
     
       12. The recording medium according to  claim 11 , wherein
 the evaluation processing calculates an amount of display of the goods, based on the classification result, information about the change area, and monitored area information indicating a target area where the display state of the goods is monitored in the captured image.