System and method for facilitating transactions of a physical product or real life service via an augmented reality environment

Abstract

Techniques are disclosed for facilitating electronic commerce in an augmented reality environment. In some embodiments, a method comprises detecting, by a mobile device, presence of the physical product or the real life service; and presenting, on the mobile device, information to conduct the transaction of a physical product or a real life service via the augmented reality environment. In some embodiments, a method comprises detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and prompting the user to choose an object of interest from the one or more detected targets. Among other advantages, embodiments disclosed herein provide an intuitive and integrated user experience in shopping using augmented reality devices, thereby reducing the consumer user's effort in conducting such activities, reducing necessary sales personnel and their working hours, and increasing sales.

1 . A method for facilitating transactions of a physical product or real life service via an augmented reality environment on a mobile device, the method, comprising:
 detecting, by sensors associated with the mobile device, the presence of the physical product or the real life service, within a visual perspective of a user of the mobile device, while the mobile device is in motion;   presenting, via a display associated with the mobile device, the augmented reality environment including information to conduct the transaction of the physical product or the real life service via the augmented reality environment;   wherein, the information includes purchase or service exchange information associated with the physical product or real life service;   wherein, the information is rendered translucently and disposed adjacently or partially overlaid with the product or service depicted in the augmented reality environment via the display device;   responsive to a detected shift in visual perspective of the user, adjusting the presented augmented reality environment and information to correspond with the shifted visual perspective of the user; and   initiating the transaction of the product or service via the mobile device based on responses to the presented information from the user.   
     
     
         2 . The method of  claim 1 , wherein, the presence of the product or service is detected or identified in the augmented reality environment based on a shape of a physical object associated with the product or service. 
     
     
         3 . The method of  claim 1 , wherein, the presence of the product or service is detected or identified in the augmented reality environment by a geographic location of the product or service. 
     
     
         4 . The method of  claim 1 , wherein, the presence of the product is detected or identified in the augmented reality environment by one or more of: (i) a visual marker; (ii) a marker or tag; (iii) a one-dimensional barcode; or (iv) a multi-dimensional barcode, on the product. 
     
     
         5 . The method of  claim 1 , wherein, the presence of the product is detected or identified in the augmented reality environment by a radio frequency identification (RFID) chip coupled to the product. 
     
     
         6 . The method of  claim 1 , wherein, the presence of the product is detected or identified in the augmented reality environment by optical character recognition (OCR) of written materials on or nearby the product. 
     
     
         7 . The method of  claim 1 , further comprising:
 receiving input from the user, via an input device associated with the mobile device, to disambiguate an identity of the product or service.   
     
     
         8 . The method of  claim 7 , wherein the user's input includes at least partially a name of the product or service. 
     
     
         9 . The method of  claim 1 , further comprising:
 receiving advisory data associated with the product or service, the advisory data being added by another user of the augmented reality environment.   
     
     
         10 . The method of  claim 9 , wherein the advisory data includes one or more of:
 (i) metadata or tags relevant to the product or service, or (ii) an annotation that is descriptive of the product or service.   
     
     
         11 . The method of  claim 1 , further comprising:
 prompting the user to enter an advisory data for the product or service; and   sharing the user's entry to another user of the augmented reality environment.   
     
     
         12 . The method of  claim 1 , wherein, the mobile device includes one or more of: (i) an eyewear, (ii) a visor, (ii) a pair of goggles, (iv) a mobile phone, (v) a smart phone, (vi) a tablet, (vii) a phablet, or (viii) a head mounted display or device. 
     
     
         13 . The method of  claim 1 , wherein, the information further includes advisory data associated with the product or service. 
     
     
         14 . The method of  claim 13 , wherein, the advisory data includes annotations or metadata or tags contributed by another user of the augmented reality environment. 
     
     
         15 . The method of  claim 1 , wherein, an advertisement relevant to the product or service is identified and displayed in the augmented reality environment via the mobile device. 
     
     
         16 . The method of  claim 15 , wherein, the advertisement is identified or detected based on one or more of:
 (i) location, (ii) time, (iii) interest or profile of a user of the mobile device.   
     
     
         17 . The method of  claim 15 , wherein, the advertisement is identified or detected based on a pointing direction of the mobile device. 
     
     
         18 . The method of  claim 15 , wherein, the advertisement is identified or detected based on velocity or speed of movement of the mobile device. 
     
     
         19 . The method of  claim 15 , wherein, the advertisement is identified or detected based on an ambient temperature in which the mobile device physically resides. 
     
     
         20 . The method of  claim 15 , wherein, the advertisement is identified or detected by the sensors on the mobile device. 
     
     
         21 . The method of  claim 15 , wherein, the advertisement is identified or detected based on a landmark which the mobile device is pointed at or in a vicinity of. 
     
     
         22 . The method of  claim 1 , wherein, the information includes one or more of: (i) a price, (ii) a price comparison among different merchants, (iii) a review, or (iv) an availability, of the product or service. 
     
     
         23 . The method of  claim 1 , wherein, the mobile device prompts the user to contact the sale representative of the product or service based on a contact information included in the information. 
     
     
         24 . The method of  claim 1 , wherein, the mobile device allows the user to bookmark the product or service. 
     
     
         25 . The method of  claim 24 , wherein, the mobile device allows the user to share the bookmark with another user of the augmented reality environment. 
     
     
         26 . A system for facilitating transactions of a physical product or real life service via an augmented reality environment, the system comprising:
 sensors;   a display device;   a processor;   a memory having stored thereon instructions which, when executed by the processor, cause the system to:
 detect, by the sensors, the presence of the physical product or the real life service, within a visual perspective of a user of the system, while the system is in motion; 
 present, via the display device, the augmented reality environment, including information to conduct the transaction of the physical product or the real life service via the augmented reality environment; 
 wherein, the information includes purchase or service exchange information associated with the physical product or real life service; 
 wherein, the information is rendered translucently and disposed adjacently or partially overlaid with the product or service depicted in the augmented reality environment via the display device; 
 adjust the presented augmented reality environment and information to correspond with a detected shifted visual perspective of the user; and 
 initiate the transaction of the product or service via the mobile device based on responses to the presented information from the user. 
   
     
     
         27 . The system of  claim 26 , wherein the presence of the product or service is detected or identified in the augmented reality environment based on a shape of a physical object associated with the product or service. 
     
     
         28 . The system of  claim 26 , wherein the presence of the product or service is detected or identified in the augmented reality environment by a geographic location of the product or service. 
     
     
         29 . The system of  claim 26 , wherein the instructions further cause the system to:
 receive, via the input device, an input from the user to disambiguate an identity of the product or service, wherein the user's input includes at least partially a name of the product or service.   
     
     
         30 . The system of  claim 26 , wherein the instructions further cause the system to:
 receive advisory data associated with the product or service, the advisory data being added by another user of the augmented reality environment.   
     
     
         31 . The system of  claim 26 , wherein the instructions further cause the system to:
 prompt the user to enter an advisory data for the product or service; and   share the user's entry to another user of the augmented reality environment.   
     
     
         32 . The system of  claim 26 , wherein an advertisement relevant to the product or service is identified and displayed in the augmented reality environment via the system. 
     
     
         33 . The system of  claim 32 , wherein, the advertisement is identified or detected based on a pointing direction of the system. 
     
     
         34 . The system of  claim 26 , wherein the system comprises a mobile computing device. 
     
     
         35 . A system for facilitating transactions of a physical product or real life service via an augmented reality environment, the system comprising:
 means for detecting, by the system, the presence of the physical product or the real life service, within a visual perspective of a user of the system, while the system is in motion; and   means for presenting the augmented reality environment, including information to conduct the transaction of the physical product or the real life service via the augmented reality environment;   wherein, the information includes purchase or service exchange information associated with the physical product or real life service;   wherein, the information is rendered translucently and disposed adjacently or partially overlaid with the product or service depicted in the augmented reality environment;   means for adjusting the presented augmented reality environment and information to correspond with a detected shifted visual perspective of the user; and   means for initiating the transaction of the product or service based on responses to the presented information from the user.   
     
     
         36 . The system of  claim 35 , wherein the presence of the product is detected or identified in the augmented reality environment based on a shape of a physical object associated with the product or service. 
     
     
         37 . The system of  claim 35 , further comprising:
 means for receiving input from a user to disambiguate an identity of the product or service, wherein the user's input includes at least partially a name of the product or service.   
     
     
         38 . The system of  claim 35 , further comprising:
 means for receiving advisory data associated with the product or service, the advisory data being added by another user of the augmented reality environment.   
     
     
         39 . The system of  claim 36 , further comprising:
 means for prompting the user to enter an advisory data for the product or service; and   means for sharing the user's entry to another user of the augmented reality environment.   
     
     
         40 . The system of  claim 35 , wherein an advertisement relevant to the product or service is identified and presented in the augmented reality environment via the display of the system.