System and method for selecting targets in an augmented reality environment

Abstract

Techniques are disclosed for facilitating electronic commerce in an augmented reality environment. In some embodiments, a method comprises detecting, by a mobile device, presence of the physical product or the real life service; and presenting, on the mobile device, information to conduct the transaction of a physical product or a real life service via the augmented reality environment. In some embodiments, a method comprises detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and prompting the user to choose an object of interest from the one or more detected targets. Among other advantages, embodiments disclosed herein provide an intuitive and integrated user experience in shopping using augmented reality devices, thereby reducing the consumer user's effort in conducting such activities, reducing necessary sales personnel and their working hours, and increasing sales.

What is claimed is: 
     
         1 . A method for selecting a physical product or a real life service in an augmented reality platform via a mobile device, the method comprising:
 detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and   prompting the user to choose an object of interest from the one or more detected targets.   
     
     
         2 . The method of  claim 1 , further comprising:
 providing, via a display of the mobile device, the user with a lasso tool in the perspective to surround a respective target so as to form the select area.   
     
     
         3 . The method of  claim 1 , further comprising:
 prompting, via a display of the mobile device, the user to enter a learning mode in which the mobile device receives an assistance from the user to perform the detection.   
     
     
         4 . The method of  claim 3 , wherein the assistance includes one or more of:
 (i) entering at least partially a name, (ii) entering metadata, (iii) defining a boundary via a pointer, or (iv) taking snapshots from a plurality of views to develop a recognition pattern, for a respective target.   
     
     
         5 . The method of  claim 1 , further comprising:
 receiving, via the mobile device, the user's choice of the object of interest.   
     
     
         6 . The method of  claim 5 , further comprising:
 detecting, via the mobile device, one or more of: (i) movement and selection by a selection tool or a pointer, or (ii) movement and selection represented by a gesture.   
     
     
         7 . The method of  claim 6 , further comprising:
 capturing, via the mobile device, the gesture from one or more of: (i) movements or non-movements of an eye of the user, (ii) locations of a focal point of an eye of the user, or (iii) movements of an eye lid of the user.   
     
     
         8 . The method of  claim 6 , further comprising:
 capturing, via the mobile device, the gesture from one or more of: (i) movements of hand or finger as recognized by a camera of the mobile device, (ii) movements of a virtual pointer controlled by a wireless peripheral device, (iv) movements of a virtual pointer controlled by a touch-sensitive display of the mobile device, or (v) movements of the mobile device itself.   
     
     
         9 . The method of  claim 8 , wherein the capturing is further based on a speed or velocity of the movements. 
     
     
         10 . The method of  claim 5 , further comprising:
 confirming, via the mobile device, with the user of the choice of the object of interest.   
     
     
         11 . The method of  claim 5 , wherein the confirmation comprises highlighting or outlining the target in the augmented reality platform. 
     
     
         12 . The method of  claim 1 , wherein the device is in form of an electronic eyewear or a head-mounted device. 
     
     
         13 . The method of  claim 1 , wherein the target is a physical or a virtual goods. 
     
     
         14 . A mobile device for an augmented reality platform, the device comprising:
 a processor; and   a memory coupled to the processor and storing a plurality of instructions which, when executed by the processor, cause the processor to:
 detect one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by the mobile device; and 
 prompt the user to choose an object of interest from the one or more detected targets. 
   
     
     
         15 . The device of  claim 14 , wherein the processor is further instructed to:
 provide, via a display of the mobile device, the user with a lasso tool in the perspective to surround a respective target so as to form the select area.   
     
     
         16 . The device of  claim 14 , wherein the processor is further instructed to:
 prompt, via a display of the mobile device, the user to enter a learning mode in which the mobile device receives an assistance from the user to perform the detection.   
     
     
         17 . The device of  claim 16 , wherein the assistance includes one or more of:
 (i) entering at least partially a name, (ii) entering metadata, (iii) defining a boundary via a pointer, or (iv) taking snapshots from a plurality of views to develop a recognition pattern, for a respective target.   
     
     
         18 . The device of  claim 14 , wherein the processor is further instructed to:
 receive, via the mobile device, the user's choice of the object of interest.   
     
     
         19 . The device of  claim 18 , wherein the processor is further instructed to:
 detect, via the mobile device, one or more of: (i) movement and selection by a selection tool or a pointer, or (ii) movement and selection represented by a gesture.   
     
     
         20 . The device of  claim 19 , wherein the processor is further instructed to:
 capture, via the mobile device, the gesture from one or more of: (i) movements or non-movements of an eye of the user, (ii) locations of a focal point of an eye of the user, or (iii) movements of an eye lid of the user.   
     
     
         21 . The device of  claim 19 , wherein the processor is further instructed to:
 capture, via the mobile device, the gesture from one or more of: (i) movements of hand or finger as recognized by a camera of the mobile device, (ii) movements of a virtual pointer controlled by a wireless peripheral device, (iv) movements of a virtual pointer controlled by a touch-sensitive display of the mobile device, or (v) movements of the mobile device itself.   
     
     
         22 . The device of  claim 21 , wherein the processor is further instructed to:
 capture based on a speed or velocity of the movements.   
     
     
         23 . The device of  claim 18 , wherein the processor is further instructed to:
 confirm, via the mobile device, with the user of the choice of the object of interest.   
     
     
         24 . The device of  claim 23 , wherein the confirmation comprises highlighting or outlining the target in the augmented reality platform. 
     
     
         25 . The device of  claim 14 , wherein the device is in form of an electronic eyewear or a head-mounted device. 
     
     
         26 . The device of  claim 14 , wherein the target is a physical or a virtual goods.