Image Annotation Over Different Occurrences of Images Using Image Recognition

Abstract

This disclosure relates to a system for acquiring and sharing annotations of images over a network based on fingerprint identification techniques for digital images. The system allows users to annotate images found on the network that are not controlled by the user. Annotations are stored on a database, thereby allowing multiple users to access to all annotations associated with that image. The database includes a “fingerprint value” that is associated with each image, and which allows the image to be identified when viewed, regardless of that image's URL or website location. The complete annotation data for the image being viewed may then be presented to the viewer of the image in a website browser or other viewing application.

I claim: 
     
         1 . A method comprising:
 a) constructing a database having:
 i) item records each identifying a media item accessible on a network and containing a fingerprint value for the media item, 
 ii) network location records associated with the item records, each network location record containing a location on the network where the media item identified in the associated item record is found; 
 iii) annotation records associated with the item records, each annotation record containing an annotation concerning the media item identified in the associated item record; 
   b) at a server computer, receiving from a first remote application a first network location for a first media item found on the network;   c) at the server computer, comparing a first fingerprint value for the first media item against the fingerprint values in the item records to find a matching item record;   d) at the server computer, creating a first network location record containing the first network location and associating the first network location record with the matching item record;   e) at the server computer, receiving from the first remote application a first annotation for the first media item; and   f) at the server computer, creating a first annotation record containing the first annotation and associating the first annotation record with the matching item record.   
     
     
         2 . The method of  claim 1 , wherein the first fingerprint value for the first media item is created by applying a hash algorithm to the first media item. 
     
     
         3 . The method of  claim 2 , wherein the server computer downloads a copy of the first media item from the first network location before the hash algorithm is applied to the copy of the first media item. 
     
     
         4 . The method of  claim 3 , wherein the server computer uses its own processor to apply the hash algorithm to the copy of the first media item. 
     
     
         5 . The method of  claim 2 , wherein the first fingerprint value for the first media item is stored in the first network location record. 
     
     
         6 . The method of  claim 5 , further comprising:
 g) at the server computer, receiving from a second remote application a second network location relating to an unknown media item;   h) at the server computer, comparing a second fingerprint value for the unknown media item against the fingerprint values in the database to find that the unknown media item matches the matching item record for the first media item;   i) at the server computer, creating a second network location record containing the second network location and associating the second network location record with the matching item record; and   j) at the server computer, transmitting to the second remote application the first annotation record.   
     
     
         7 . The method of  claim 6 , wherein the first network location record contains the first fingerprint value, and further wherein the comparing step h) compares the second fingerprint value against the first fingerprint value in the first network location record. 
     
     
         8 . The method of  claim 6 , further comprising:
 k) at the server computer, receiving from the second remote application a second annotation for the first media item created when the first media item is viewed at the second network location; and   l) at the server computer, creating a second annotation record containing the second annotation and associating the second annotation record with the matching item record.   
     
     
         9 . The method of  claim 8 , wherein the first annotation is textual, and the second annotation comprises audio commentary. 
     
     
         10 . The method of  claim 9 , further comprising receiving from a third remote application a request for media item annotation, and responding to the request by transmitting the first annotation and the second annotation. 
     
     
         11 . The method of  claim 10 , wherein the request for media item annotation includes a requested network location, further comparing the requested network location against the network location records to find a match between the requested network location and one of the first network location and the second network location. 
     
     
         12 . The method of  claim 2 , wherein the first media item is an image. 
     
     
         13 . The method of  claim 2 , wherein fingerprint values are considered to match even when they are not identical. 
     
     
         14 . The method of  claim 13 , wherein matches are determined in part by hamming distances between hash values. 
     
     
         15 . The method of  claim 6 , further comprising:
 k) at the server computer, receiving a request to query the database from a direct-access interface, the query request containing a query string;   l) at the server computer, searching the database to find instances of the query string in relevant records of the data base, the relevant records chosen from the set of record comprising item records, network location records, and annotation records; and   m) at the server computer, using the relevant records to identify a network location to at least one relevant media item; and   n) at the server computer, returning data from the relevant records and links to the at least one relevant media item.   
     
     
         16 . An server apparatus comprising:
 a) database communications to a database, the database having:
 i) item records each identifying a media item accessible on a network and containing a fingerprint value for the media item, 
 ii) network location records associated with the item records, each network location record containing a location on the network where the media item identified in the associated item record is found; 
 iii) annotation records associated with the item records, each annotation record containing an annotation concerning the media item identified in the associated item record; 
   b) a computer processor operating under programmed control of programming instructions;   c) a memory device containing the programming instructions; and   d) the programming instructions on the memory device, operably by the processor to perform the following functions:
 i) receive from a first remote application a first network location for a first media item found on the network; 
 ii) compare a first fingerprint value for the first media item against the fingerprint values in the item records to find a matching item record; 
 iii) create a first network location record containing the first network location and associate the first network location record with the matching item record; 
 iv) receive from the first remote application a first annotation for the first media item; and 
 v) create a first annotation record containing the first annotation and associate the first annotation record with the matching item record.