System and method for presenting content based on articles properly presented and verifiably owned by or in possession of user

Abstract

A system and method for identifying whether an article is properly presented and duly owned by or licensed to a user and releasing assigned content to the user upon confirmation of such verifiably owned or licensed article. A manipulated user device equipped with at least one camera is deployed to determine if the article is properly presented. The device captures images and the system has the ability to determine from the images and any additional spatial information the orientation and/or position parameters of the article to confirm whether a valid spatial relationship exists between the article and the user device. Due ownership or license is verified by relying on tokens (e.g., Non-Fungible Tokens) and blockchain transaction records. The assigned content released to the user can be contextual and can range from items such as images, music, videos, games, virtual content, augmented content, coupons (virtual or physical), promotions, special offers and the like.

The invention claimed is: 
     
       1. A system for identifying an article presented by a user in an environment and conditionally displaying an assigned content to said user, said system comprising:
 a) a manipulated user device having at least one camera, said manipulated user device being held in hand and manipulated by said user; 
 b) a pose estimation module for estimating a pose of said manipulated user device in said environment; 
 c) an image recognition module in communication with said at least one camera, said image recognition module recognizing said article and providing an article pose estimate to at least one camera image containing said article from a best match with one or more reference images of articles to obtain a recognized article; 
 d) a spatial computation module in communication with said image recognition module and with said pose estimation module, said spatial computation module estimating a valid spatial relationship between said recognized article and said user based on said pose of said manipulated device and said article pose estimate thereby validating that said recognized article is associated with said user through determination that said recognized article is validly presented by said user; 
 e) a rights verification module in communication with said image recognition module, said rights verification module looking up a token associated with said article and stored on a blockchain to determine whether the rights to view the assigned content are verifiably owned by or licensed to said user; 
 whereby said manipulated user device displays said assigned content after establishing a condition that said recognized article is validly presented by said user and said user verifiably possesses the rights to view said assigned content. 
 
     
     
       2. The system of  claim 1 , wherein said user device displays non-assigned content to said user prior to establishing said condition, said non-assigned content comprising information about presenting said article in a presentation pose in a field of view of said at least one camera. 
     
     
       3. The system of  claim 2 , wherein said article is selected from the group consisting of a sneaker, a shoe, a hat, a jewelry, an adornment, an article of clothing, a wearable item and a manipulatable item. 
     
     
       4. The system of  claim 2 , wherein said article comprises an augmented reality anchor. 
     
     
       5. The system of  claim 4 , wherein said article comprising said augmented reality anchor is available when said environment is a predetermined environment selected from the group consisting of in-store environments, performance environments, social venue environments, and museum environments. 
     
     
       6. The system of  claim 2 , wherein said presentation pose comprises a predetermined proximity to said at least one camera. 
     
     
       7. The system of  claim 1 , wherein said token is a non-fungible token stored on said manipulated user device and confirmed and authenticated cryptographically on said blockchain by said rights verification module. 
     
     
       8. The system of  claim 1 , wherein said token is a non-fungible token accessed through an account of said user and confirmed and authenticated cryptographically on said blockchain by said rights verification module. 
     
     
       9. The system of  claim 1 , wherein said token is subject to a transaction by said user in a marketplace, said transaction being recorded on said blockchain. 
     
     
       10. The system of  claim 9 , wherein said transaction is a sale and wherein said user loses access to said assigned content once said sale is recorded on said blockchain. 
     
     
       11. The system of  claim 1 , wherein said assigned content is selected from the group consisting of a music item, a video item, an image, a 3D model, a game item, a video game content, a virtual content, an augmented content, a coupon, a promotion and a special offer. 
     
     
       12. The system of  claim 11 , wherein said manipulated user device is an augmented reality device and said content comprises at least one virtual object displayed to said user. 
     
     
       13. The system of  claim 1 , wherein said rights verification module satisfies at least one of two conditions:
 a) that said user possesses said token associated with said article and thus has the rights to view said assigned content, or 
 b) that said user is in a specified location granting access to said assigned content before said user has purchased the rights, such as viewing the assigned content in a retail shop or museum. 
 
     
     
       14. A method for identifying in an environment an article presented by a user equipped with a manipulated user device, said manipulated user device being held in hand and manipulated by said user and having at least one camera and conditionally displaying an assigned content to said user, said method comprising:
 a) estimating a pose of said manipulated user device in said environment with a pose estimation module; 
 b) recognizing said article and determining an article pose estimate of said article from at least one camera image containing said article, wherein said recognizing step is based on a best match with one or more reference images of articles to obtain a recognized article using an image recognition module that is in communication with said at least one camera; 
 c) estimating a valid spatial relationship between said recognized article and said user based on said pose of said manipulated device and said article pose estimate using a spatial computation module in communication with said image recognition module and with said pose estimation module, thereby validating that said recognized article is associated with said user through determination that said recognized article is validly presented by said user; 
 d) looking up a token associated with said article and stored on a blockchain by a rights verification module in communication with said image recognition module to determine whether said article is verifiably owned by or licensed to said user; and 
 e) establishing a condition that said recognized article is validly presented by said user and verifiably owned by or licensed to said user; 
 wherein said manipulated device displays said assigned content after establishing said condition. 
 
     
     
       15. The method of  claim 14 , wherein said user device displays non-assigned content to said user prior to establishing said condition, said non-assigned content comprising information about presenting said article in a presentation pose in a field of view of said at least one camera. 
     
     
       16. The method of  claim 15 , wherein said article is selected from the group consisting of a sneaker, a shoe, a hat, a jewelry, an adornment, an article of clothing, a wearable item and a manipulatable item. 
     
     
       17. The method of  claim 15 , wherein said article comprises an augmented reality anchor. 
     
     
       18. The method of  claim 17 , wherein said article comprising said augmented reality anchor is available when said environment is a predetermined environment selected from the group consisting of in-store environments, performance environments, social venue environments, and museum environments. 
     
     
       19. The method of  claim 15 , wherein said presentation pose comprises a predetermined proximity to said at least one camera. 
     
     
       20. The method of  claim 14 , further comprising storing said token on said manipulated user device and confirming and authenticating cryptographically said token on said blockchain by said rights verification module, and wherein said token is a non-fungible token. 
     
     
       21. The method of  claim 14 , further comprising accessing said token through an account of said user and confirming and authenticating cryptographically said token on said blockchain by said rights verification module, and wherein said token is a non-fungible token. 
     
     
       22. The method of  claim 14 , further comprising transacting said token by said user in a marketplace, and recoding said transacting on said blockchain. 
     
     
       23. The method of  claim 22 , wherein said transacting comprises a sale and wherein said user loses access to said assigned content once said sale is recorded on said blockchain. 
     
     
       24. The method of  claim 14 , wherein said assigned content is selected from the group consisting of a music item, a video item, an image, a 3D model, a game item, a video game content, a virtual content, an augmented content, a coupon, a promotion and a special offer. 
     
     
       25. The method of  claim 14 , wherein said manipulated user device is an augmented reality device and said content comprises at least one virtual object displayed to said user.