Multi-modality localization of users

Abstract

Systems and methods providing for determining physical location of a device of a user of an augmented reality environment corresponding to a physical space. The systems and methods involve requesting and receiving a list of participating users having a GPS location within a predetermined radius of a first device; sending advertising and scanning beacons, via a first wireless network, to generate a second list of devices present in the physical space; performing simultaneous localization and mapping (SLAM) using the participating devices of the second list; generating a third list based at least partly on a Bluetooth connection between the one or more participating devices of the second list; and identifying the participating devices of the third list.

What is claimed is: 
     
         1 . A system for determining a physical location of a device of a user of an augmented reality environment corresponding to a physical space, the system comprising one or more processors configured performing the operations of:
 determining a plurality of participating devices present in a physical space;   performing simultaneous localization and mapping (SLAM) using the participating devices;   generating an augmented reality representation of the physical space for display on one or more of the plurality of participating devices; and   visually identifying the participating devices in the augmented reality representation.   
     
     
         2 . The system of  claim 1 , wherein visually identifying comprises:
 highlighting an area around the participating device, overlaying graphics proximate to the participant device, labelling the participating devices with information related to a participant or the participating device, or combination thereof.   
     
     
         3 . The system of  claim 1 , wherein the plurality of participating devices each have a GPS location and the GPS location is within a predetermined distance of a first device of a first user. 
     
     
         4 . The system of  claim 1 , wherein performing SLAM comprises:
 receiving three-dimensional maps of the physical space from the participating devices; and   merging the three-dimensional maps into a merged map of the physical space.   
     
     
         5 . The system of  claim 1 , wherein determining a plurality of participating devices comprises:
 receiving a first list of participating devices having locations within a predetermined radius of a first device of a first user of the augmented reality environment;   generating, based at least partly on advertising beacons and scanning beacons sent from the participating devices, a second list, wherein the second list comprises participating devices present in the physical space;   generating, based at least partly on a wireless connection between one or more participating devices of the second list, a third list, wherein the third list comprises participating devices of the second list determined to be within a predetermined distance of one another; and   identifying the participating devices of the third list as the plurality of participating devices.   
     
     
         6 . The system of  claim 5 , further comprising:
 receiving three-dimensional maps of the physical space from the participating devices of the second list; and   generating a submap of the physical space, comprising the three-dimensional maps of the physical space received from the participating devices of the second list.   
     
     
         7 . The system of  claim 5 , wherein the augmented reality representation comprises a three-dimensional map of the physical space generated, at least in part by performing SLAM using the participating devices of the second list. 
     
     
         8 . The method of  claim 5 , wherein the one or more processors are further configured to perform the operations of:
 locating the identified participants in one or more three-dimensional maps of the physical space, generated by the participating devices of the second and/or third list.   
     
     
         9 . The system of  claim 5 , wherein the one or more processors are further configured to perform the operations of:
 receiving device identifiers in response to the advertising and scanning beacons, wherein generating the second list comprises removing participating devices of the first list whose device identifiers are not received.   
     
     
         10 . The system of  claim 5 , wherein performing SLAM is divided between the participating devices of the third list. 
     
     
         11 . A method for determining a physical location of a device of a user of an augmented reality environment corresponding to a physical space, the method comprising:
 determining a plurality of participating devices present in a physical space;   performing simultaneous localization and mapping (SLAM) using the participating devices;   generating an augmented reality representation of the physical space for display on one or more of the plurality of participating devices; and   visually identifying the participating devices in the augmented reality representation.   
     
     
         12 . The method of  claim 11 , wherein visually identifying comprises:
 highlighting an area around the participating device, overlaying graphics proximate to the participant device, labelling the participating devices with information related to a participant or the participating device, or combination thereof.   
     
     
         13 . The method of  claim 11 , wherein the plurality of participating devices each have a GPS location and the GPS location is within a predetermined distance of a first device of a first user. 
     
     
         14 . The method of  claim 11 , wherein performing SLAM comprises:
 receiving three-dimensional maps of the physical space from the participating devices; and   merging the three-dimensional maps into a merged map of the physical space.   
     
     
         15 . The method of  claim 11 , wherein determining a plurality of participating devices comprises:
 receiving a first list of participating devices having locations within a predetermined radius of a first device of a first user of the augmented reality environment;   generating, based at least partly on advertising beacons and scanning beacons sent from the participating devices, a second list, wherein the second list comprises participating devices present in the physical space;   generating, based at least partly on a wireless connection between one or more participating devices of the second list, a third list, wherein the third list comprises participating devices of the second list determined to be within a predetermined distance of one another; and   identifying the participating devices of the third list as the plurality of participating devices.   
     
     
         16 . The method of  claim 15 , further comprising:
 receiving three-dimensional maps of the physical space from the participating devices of the second list; and   generating a submap of the physical space, comprising the three-dimensional maps of the physical space received from the participating devices of the second list.   
     
     
         17 . The method of  claim 15 , wherein the augmented reality representation comprises a three-dimensional map of the physical space generated, at least in part by performing SLAM using the participating devices of the second list. 
     
     
         18 . The method of  claim 15 , further comprising:
 locating the identified participants in one or more three-dimensional maps of the physical space, generated by the participating devices of the second and/or third list.   
     
     
         19 . The method of  claim 15 , further comprising:
 receiving device identifiers in response to the advertising and scanning beacons, wherein generating the second list comprises removing participating devices of the first list whose device identifiers are not received.   
     
     
         20 . The method of  claim 15 , wherein performing SLAM is divided between the participating devices of the third list.