Storefront device, storefront management method, and program

Abstract

First position information indicating positions of approaching people nearing merchandise is acquired. Second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people, is detected. A movement action performed on the merchandise is detected. An ID of a person corresponding to the subject person who performed the detected movement action is specified based on a positional relationship between the first position information and the second position information.

The invention claimed is: 
     
       1. A storefront device comprising:
 at least one memory configured to store instructions; and 
 at least one processor configured to execute instructions to:
 acquire first position information indicating positions of approaching people who are nearing merchandise; 
 detect second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people; 
 acquire third position information indicating a position of the merchandise when the merchandise is picked up; 
 specify, based on the first position information and the second position information, identification information of the subject person corresponding to the facial feature information; 
 specify, based on the second position information and the third position information, the merchandise as being picked up by the subject person; and 
 generate management information by associating the identification information and the specified merchandise. 
 
 
     
     
       2. The storefront device according to  claim 1 , wherein:
 the second position information relates to an axis indicating an arm of the subject person who has stretched the arm out towards the merchandise. 
 
     
     
       3. The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 delete, from the management information, the merchandise returned by the subject person. 
 
     
     
       4. The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 output, to the subject person, display information regarding sales information of the merchandise, based on the management information corresponding to the subject person. 
 
     
     
       5. The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 acquire the first position information within a three-dimensional space of feature information of the subject person captured by a first camera. 
 
     
     
       6. The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 detect whether a movement action indicates that the subject person picked up or returned the merchandise based on movement information of the merchandise captured by a second camera. 
 
     
     
       7. The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 detect whether a movement action is an acquisition action or a return action of the merchandise based on movement information of the merchandise. 
 
     
     
       8. A storefront management method comprising:
 acquiring first position information indicating positions of approaching people nearing merchandise; 
 detecting second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people; 
 acquiring third position information indicating a position of the merchandise when the merchandise is picked up; 
 specifying, based on the first position information and the second position information, identification information of the subject person corresponding to the facial feature information; 
 specifying, based on the second position information and the third position information, the merchandise as being picked up by the subject person; and 
 generating management information by associating the identification information and the specified merchandise. 
 
     
     
       9. A non-transitory computer-readable recording medium storing a program for causing a computer of a storefront device to execute processes, the processes comprising:
 acquiring first position information indicating positions of approaching people nearing merchandise; 
 detecting second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people; 
 acquiring third position information indicating a position of the merchandise when the merchandise is picked up; 
 specifying, based on the first position information and the second position information, identification information of the subject person corresponding to the facial feature information; 
 specifying, based on the second position information and the third position information, the merchandise as being picked up by the subject person; and 
 generating management information by associating the identification information and the specified merchandise.