Automated User Content Processing for Augmented Reality

Abstract

A method and system for augmenting images in physical documents with additional digital media content is described. A user device can scan the images and automatically retrieve and render the associated digital media content. Combinations of photographs, audio, maps and videos may be generated to allow users to create a cohesive interactive story. Some aspects of the disclosure involve gathering content to generate a physical document with augmented images, analyzing images for suitability to be augmented, linking images with digital media content, and generating augmented images from digital media content such as digital images, videos, and maps.

What is claimed is: 
     
         1 - 20 . (canceled) 
     
     
         21 . A computer-implemented method for providing augmented reality user experience, the method comprising:
 receiving, by one or more processors, a selection of a document type and a digital image;   determining, by the one or more processors, that the digital image satisfies one or more criteria for inclusion in a document that corresponds to the document type, the one or more criteria being based on the selection of the document type;   responsive to determining that the digital image satisfies the one or more criteria for generating the document:
 storing, by the one or more processors in a storage database, the digital image; and 
 obtaining, by the one or more processors, supplemental data to supplement the digital image; 
   generating, by the one or more processors, a graphical representation that encodes a link from the digital image to the supplemental data such that the link provides access to the supplemental data from the digital image; and   providing, by the one or more processors, instructions to generate the document that corresponds to the selected document type, the document comprising the digital image and the link that provides access to the supplemental data from the digital image.   
     
     
         22 . The computer-implemented method of  claim 21 , further comprising:
 receiving, at the one or more processors, data corresponding to the graphical representation from the physical document; and   responsive to receiving the data corresponding to the graphical representation:
 decoding the link from the digital image to the supplemental data; 
 obtaining, from the storage database, the supplemental data; and 
 transmitting the supplemental data. 
   
     
     
         23 . The computer-implemented method of  claim 21 , wherein obtaining the supplemental data to supplement the digital image comprises obtaining one or more of an image file, a video file, and global positioning data. 
     
     
         24 . The computer-implemented method of  claim 21 , wherein:
 the digital image comprises a map image;   obtaining the supplemental data to supplement the digital image comprises:
 obtaining global positioning data; and 
 determining location information based on the global positioning data; and 
   providing the instructions to generate the document comprises:
 providing instructions to superimpose the graphical representation on the map image in the document. 
   
     
     
         25 . The computer-implemented method of  claim 21 , wherein:
 obtaining the supplemental data to supplement the digital image comprises obtaining video data or still image data; and   providing the instructions to generate the document comprises providing instructions to superimpose the graphical representation on the digital image in the document, wherein the graphical representation encodes the link from the digital image to the video data or the still image data.   
     
     
         26 . The computer-implemented method of  claim 21 , further comprising:
 receiving user credentials; and   authenticating a user associated with the user credentials,   wherein obtaining the supplemental data to supplement the digital image comprises:
 obtaining one or more files associated with an account of the user associated with the user credentials. 
   
     
     
         27 . The computer-implemented method of  claim 21 , wherein determining that the digital image satisfies the one or more criteria for inclusion in the document that corresponds to the document type comprises:
 generating a hash identification for the digital image by applying a hash function to the digital image;   comparing the hash identification for the digital image with a hash identification associated with an asset stored in the storage database;   determining a hamming distance based on the comparing of the hash identification for the digital image with the hash identification associated with the asset stored in the storage database; and   determining that the hamming distance satisfies a distance threshold.   
     
     
         28 . The computer-implemented method of  claim 21 , further comprising:
 obtaining, by the one or more processors, a subsequent digital image;   generating, by the one or more processors, a second graphical representation that encodes a second link from the subsequent digital image to the supplemental data such that the link provides access to the supplemental data from the subsequent digital image; and   providing, by the one or more processors, instructions to generate the document that corresponds to the selected document type, the document further comprising the subsequent digital image and the second link that provides access to the supplemental data from the subsequent digital image.   
     
     
         29 . The computer-implemented method of  claim 21 , further comprising:
 responsive to receiving the selection of the document type, transmitting, by the one or more processors to a user device, a template for the document type.   
     
     
         30 . A non-transitory computer-readable storage medium comprising instructions, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
 receiving a selection of a document type and a digital image;   determining that the digital image satisfies one or more criteria for inclusion in a document that corresponds to the document type, the one or more criteria being based on the selection of the document type;   responsive to determining that the digital image satisfies the one or more criteria for generating the document:
 storing, in a storage database, the digital image; and 
 obtaining supplemental data to supplement the digital image; 
   generating a graphical representation that encodes a link from the digital image to the supplemental data such that the link provides access to the supplemental data from the digital image; and   providing instructions to generate the document that corresponds to the selected document type, the document comprising the digital image and the link that provides access to the supplemental data from the digital image.   
     
     
         31 . The non-transitory computer-readable storage medium of  claim 30 , wherein the operations further comprise:
 receiving data corresponding to the graphical representation from the physical document; and   responsive to receiving the data corresponding to the graphical representation:
 decoding the link from the digital image to the supplemental data; 
 obtaining, from the storage database, the supplemental data; and 
 transmitting the supplemental data. 
   
     
     
         32 . The non-transitory computer-readable storage medium of  claim 30 , wherein obtaining the supplemental data to supplement the digital image comprises obtaining one or more of an image file, a video file, and global positioning data. 
     
     
         33 . The non-transitory computer-readable storage medium of  claim 30 , wherein determining that the digital image satisfies the one or more criteria for inclusion in the document that corresponds to the document type comprises:
 generating a hash identification for the digital image by applying a hash function to the digital image;   comparing the hash identification for the digital image with a hash identification associated with an asset stored in the storage database;   determining a hamming distance based on the comparing of the hash identification for the digital image with the hash identification associated with the asset stored in the storage database; and   determining that the hamming distance satisfies a distance threshold.   
     
     
         34 . The non-transitory computer-readable storage medium of  claim 30 , wherein the operations further comprise:
 obtaining a subsequent digital image;   generating a second graphical representation that encodes a second link from the subsequent digital image to the supplemental data such that the link provides access to the supplemental data from the subsequent digital image; and   providing instructions to generate the document that corresponds to the selected document type, the document further comprising the subsequent digital image and the second link that provides access to the supplemental data from the subsequent digital image.   
     
     
         35 . A system comprising:
 one or more computers and one or more storage devices storing instructions that are operable and when executed by one or more computers, cause the one or more computers to perform operations comprising:
 receiving a selection of a document type and a digital image; 
 determining that the digital image satisfies one or more criteria for inclusion in a document that corresponds to the document type, the one or more criteria being based on the selection of the document type; 
 responsive to determining that the digital image satisfies the one or more criteria for generating the document:
 storing, in a storage database, the digital image; and 
 obtaining supplemental data to supplement the digital image; 
 
 generating a graphical representation that encodes a link from the digital image to the supplemental data such that the link provides access to the supplemental data from the digital image; and 
 providing instructions to generate the document that corresponds to the selected document type, the document comprising the digital image and the link that provides access to the supplemental data from the digital image. 
   
     
     
         36 . The system of  claim 35 , wherein the operations further comprise:
 receiving data corresponding to the graphical representation from the physical document; and   responsive to receiving the data corresponding to the graphical representation:
 decoding the link from the digital image to the supplemental data; 
 obtaining, from the storage database, the supplemental data; and 
 transmitting the supplemental data. 
   
     
     
         37 . The system of  claim 35 , wherein obtaining the supplemental data to supplement the digital image comprises obtaining one or more of an image file, a video file, and global positioning data. 
     
     
         38 . The system of  claim 35 , wherein determining that the digital image satisfies the one or more criteria for inclusion in the document that corresponds to the document type comprises:
 generating a hash identification for the digital image by applying a hash function to the digital image;   comparing the hash identification for the digital image with a hash identification associated with an asset stored in the storage database;   determining a hamming distance based on the comparing of the hash identification for the digital image with the hash identification associated with the asset stored in the storage database; and   determining that the hamming distance satisfies a distance threshold.   
     
     
         39 . The system of  claim 35 , wherein the operations further comprise:
 obtaining a subsequent digital image;   generating a second graphical representation that encodes a second link from the subsequent digital image to the supplemental data such that the link provides access to the supplemental data from the subsequent digital image; and   providing instructions to generate the document that corresponds to the selected document type, the document further comprising the subsequent digital image and the second link that provides access to the supplemental data from the subsequent digital image.   
     
     
         40 . The system of  claim 35 , wherein the operations further comprise:
 responsive to receiving the selection of the document type, transmitting, by the one or more processors to a user device, a template for the document type.