Augmented reality (ar) imprinting methods and systems

Abstract

Augmented reality (AR) content may be created and stored as an imprint on a virtual model, where the virtual model is modeled after or mimics a real world environment. Intuitive mobile device interfaces may be used to link content with objects or surfaces near a mobile device. Subsequent users may access the same content depending on one or more access parameters.

I claim: 
     
         1 . A method for augmented reality (AR) using a virtual model, comprising
 mapping a real world location and orientation within a geodetic datum to a pose within a virtual model, wherein virtual locations in the virtual model correspond with respective real world locations, wherein the virtual model contains virtual objects which are employable for storing and retrieving visual content, wherein a virtual object at a given virtual location is associated with a particular real world location that corresponds with the given virtual location;   selecting one or more virtual surfaces of one or more virtual objects from among the virtual objects within the virtual model using the pose within the virtual model; and   placing visual content on the selected one or more virtual surfaces such that the visual content is incorporated into and stored with the virtual model.   
     
     
         2 . The method of  claim 1 , wherein the selecting step allows selection of surfaces which are only partially within view based on the pose. 
     
     
         3 . The method of  claim 1 , wherein the one or more virtual surfaces onto which the visual content is placed includes one or more surfaces which are only partially within view based on the pose. 
     
     
         4 . The method of  claim 1 , wherein the selecting step allows selection of surfaces belonging to virtual objects a view of which is obstructed. 
     
     
         5 . The method of  claim 1 , further comprising a step of refining boundaries of the selected one or more virtual surfaces. 
     
     
         6 . The method of  claim 1 , further comprising a step of restricting access to the placed visual content. 
     
     
         7 . The method of  claim 6 , wherein access is restricted to a particular time frame. 
     
     
         8 . The method of  claim 6 , wherein access is restricted to users within a predetermined proximity with respect to certain objects or locations. 
     
     
         9 . The method of  claim 6 , wherein access is restricted to users within a predetermined distance of a virtual surface onto which the visual content was placed. 
     
     
         10 . The method of  claim 1 , wherein the virtual model corresponds to a real world. 
     
     
         11 . The method of  claim 1 , wherein the one or more virtual objects correspond with real world buildings. 
     
     
         12 . The method of  claim 1 , wherein the one or more virtual objects correspond with real world objects which include landmarks and structures. 
     
     
         13 . The method of  claim 1 , further comprising
 determining what AR content from the virtual model to serve to a user based one or more considerations; and   serving the determined AR content to a display device of the user.   
     
     
         14 . The method of  claim 13 , wherein the one or more considerations comprise a location and orientation of the display device. 
     
     
         15 . The method  claim 14 , wherein the one or more considerations further comprise the location and orientation of the display device being within a predetermined viewing distance of a virtual location of the AR content. 
     
     
         16 . The method of  claim 13 , further comprising
 storing multiple visual contents including the placed visual content with a single virtual object and/or a single surface of the single virtual object,   wherein the determined and served AR content includes at least some of the multiple visual contents.   
     
     
         17 . The method of  claim 16 , wherein the multiple visual contents are timestamped, and wherein the one or more considerations comprises the timestamps. 
     
     
         18 . The method of  claim 1 , further comprising
 generating a new virtual object within the virtual model; and   storing further AR content with the new virtual object, wherein the AR content is stored so as to be in semantic context with respect to a two- or three-dimensional configuration and arrangement of other content of the virtual model including the placed visual content,   wherein the placed visual content comprises an image or video.   
     
     
         19 . The method of  claim 18 , further comprising retrieving and serving to a display device the placed visual content and the further AR content. 
     
     
         20 . The method of  claim 1 , further comprising updating the one or more virtual objects and augmentations based on those one or more virtual objects when new virtual object data becomes available or existing data becomes outdated or expired. 
     
     
         21 . The method of  claim 1 , further comprising generating a new virtual object within the virtual model, wherein the one or more virtual surfaces selected by the selecting step is from the new virtual object, and wherein the visual content placed by the placing step is from user drawn content. 
     
     
         22 . The method of  claim 21 , further comprising retrieving and serving to a display device the visual content for display as augmented reality. 
     
     
         23 . The method of  claim 1 , further comprising
 storing multiple visual contents including the placed visual content with a single virtual object and/or a single surface of the single virtual object; and   granting access to the visual contents on a user-by-user basis.   
     
     
         24 . The method of  claim 1 , further comprising
 storing multiple visual contents including the placed visual content with a single virtual object and/or a single surface of the single virtual object; and   granting access to the visual contents on a user-by-user basis based on one or more of user identification, user class, lifetime or expiration date, and proximity at time of access request.   
     
     
         25 . A non-transitory computer readable medium comprising computer readable instructions which, when executed by one or more processors, cause the one or more processors to perform:
 mapping a real world location and orientation within a geodetic datum to a pose within a virtual model, wherein virtual locations in the virtual model correspond with respective real world locations, wherein the virtual model contains virtual objects which are employable for storing and retrieving visual content, wherein a virtual object at a given virtual location is associated with a particular real world location that corresponds with the given virtual location;   selecting one or more virtual surfaces of one or more virtual objects from among the virtual objects within the virtual model using the pose within the virtual model; and   placing visual content on the selected one or more virtual surfaces such that the visual content is incorporated into and stored with the virtual model.   
     
     
         26 . A non-transitory computer readable medium comprising computer readable instructions which, when executed by one or more processors, cause the one or more processors to perform:
 capturing an image or video of a real world environment with a camera;   recording the real world location and orientation of the camera within a geodetic datum;   mapping the real world location and orientation to a pose within a virtual model, wherein virtual locations in the virtual model correspond with respective real world locations, wherein the virtual model contains virtual objects which are employable for storing and retrieving visual content, wherein a virtual object at a given virtual location is associated with a particular real world location that corresponds with the given virtual location;   generating a new virtual object within the virtual model;   selecting the new virtual object from among the virtual objects within the virtual model using the pose within the virtual model; and   placing visual content on one or more virtual surfaces of the selected new virtual object such that the visual content is incorporated into and stored with the virtual model; and   displaying the visual content to a user as an AR augmentation to the image or video of the real world environment.   
     
     
         27 . The non-transitory computer readable medium of  claim 26 , wherein the computer readable instructions execute partly on a user's computer and partly on a remote computer. 
     
     
         28 . The non-transitory computer readable medium of  claim 26 , wherein at least the recording step is performed by a first mobile device, and wherein the selecting step is performed by the first mobile device, a second mobile device different from the first mobile device, or a cloud computing device. 
     
     
         29 . The non-transitory computer readable medium of  claim 26 , wherein the capturing step is performed by a first device which comprises the camera, and wherein the displaying step is performed by some other output device other than the first device.