System and method for signature-enhanced multimedia content searching

Abstract

A method for signature-enhanced multimedia content searching. The method includes searching through a plurality of input multimedia content elements by comparing a query to at least one tag assigned to each input multimedia content element, wherein at least one of the at least one tag assigned to each input multimedia content element is assigned based on at least one signature generated for the input multimedia content element, wherein each signature represents a concept, wherein each concept is a collection of signatures and metadata representing the concept.

What is claimed is: 
     
         1 . A method for signature-enhanced multimedia content searching, comprising:
 searching through a plurality of input multimedia content elements by comparing a query to at least one tag assigned to each input multimedia content element, wherein at least one of the at least one tag assigned to each input multimedia content element is assigned based on at least one signature generated for the input multimedia content element, wherein each signature represents a concept, wherein each concept is a collection of signatures and metadata representing the concept.   
     
     
         2 . The method of  claim 1 , further comprising:
 assigning the at least one tag to at least one of the at least one input multimedia content element.   
     
     
         3 . The method of  claim 2 , wherein assigning the at least one tag to one of the at least one input multimedia content element further comprises:
 generating at least one signature for the input multimedia content element; and   comparing the generated at least one signature to a plurality of signatures of a plurality of reference multimedia content elements to determine at least one matching reference multimedia content element, wherein each reference multimedia content element is associated with at least one predetermined tag, wherein the at least one tag assigned to each input multimedia content element includes the at least one predetermined tag of each matching reference multimedia content element.   
     
     
         4 . The method of  claim 3 , wherein the signatures of each matching reference multimedia content element match the at least one signature generated for the input multimedia content element above a predetermined threshold. 
     
     
         5 . The method of  claim 2 , wherein assigning the at least one tag to one of the at least one input multimedia content element further comprises:
 sending, to a deep content classification system, at least one of: the input multimedia content element, and the at least one signature generated for the input multimedia content element;   receiving, from the deep concept classification system, at least one concept matching the input multimedia content element; and   creating at least one tag for the input multimedia content element, wherein the created at least one tag includes the metadata representing the matching at least one concept, wherein the created at least one tag is assigned to the input multimedia content element.   
     
     
         6 . The method of  claim 1 , further comprising:
 determining, based on the comparison, at least one search result multimedia content element, wherein each search result multimedia content element is one of the at least one input multimedia content element having at least one tag matching the query above a predetermined threshold.   
     
     
         7 . The method of  claim 6 , further comprising:
 sending the at least one search result multimedia content element to a user device.   
     
     
         8 . The method of  claim 1 , wherein each input multimedia content element is at least one of: an image, graphics, a video stream, a video clip, an audio stream, an audio clip, a video frame, a photograph, images of signals, and a portion thereof. 
     
     
         9 . The method of  claim 1 , wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least partially statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core. 
     
     
         10 . A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to execute a process, the process comprising:
 searching through a plurality of input multimedia content elements by comparing a query to at least one tag assigned to each input multimedia content element, wherein at least one of the at least one tag assigned to each input multimedia content element is assigned based on at least one signature generated for the input multimedia content element, wherein each signature represents a concept, wherein each concept is a collection of signatures and metadata representing the concept.   
     
     
         11 . A system for determining driving decisions based on multimedia content elements, comprising:
 a processing circuitry; and   a memory connected to the processing circuitry, the memory containing instructions that, when executed by the processing circuitry, configure the system to:   search through a plurality of input multimedia content elements by comparing a query to at least one tag assigned to each input multimedia content element, wherein at least one of the at least one tag assigned to each input multimedia content element is assigned based on at least one signature generated for the input multimedia content element, wherein each signature represents a concept, wherein each concept is a collection of signatures and metadata representing the concept.   
     
     
         12 . The system of  claim 11 , wherein the system is further configured to:
 assign the at least one tag to at least one of the at least one input multimedia content element.   
     
     
         13 . The system of  claim 12 , wherein the system is further configured to:
 generate at least one signature for each input multimedia content element; and   compare the generated at least one signature for each input multimedia content element to a plurality of signatures of a plurality of reference multimedia content elements to determine at least one matching reference multimedia content element, wherein each reference multimedia content element is associated with at least one predetermined tag, wherein the at least one tag assigned to each input multimedia content element includes the at least one predetermined tag of each matching reference multimedia content element.   
     
     
         14 . The system of  claim 13 , wherein the signatures of each matching reference multimedia content element match the at least one signature generated for the input multimedia content element above a predetermined threshold. 
     
     
         15 . The system of  claim 12 , wherein the system is further configured to:
 send, to a deep content classification system, at least one of: each input multimedia content element, and the at least one signature generated for each input multimedia content element;   receive, from the deep concept classification system, at least one concept matching each input multimedia content element; and   create at least one tag for each input multimedia content element, wherein the created at least one tag for each input multimedia content element includes the metadata representing the at least one concept matching the input multimedia content element, wherein the created at least one tag is assigned to the respective input multimedia content element.   
     
     
         16 . The system of  claim 11 , wherein the system is further configured to:
 determine, based on the comparison, at least one search result multimedia content element, wherein each search result multimedia content element is one of the at least one input multimedia content element having at least one tag matching the query above a predetermined threshold.   
     
     
         17 . The system of  claim 16 , wherein the system is further configured to:
 send the at least one search result multimedia content element to a user device.   
     
     
         18 . The system of  claim 11 , wherein each input multimedia content element is at least one of: an image, graphics, a video stream, a video clip, an audio stream, an audio clip, a video frame, a photograph, images of signals, and a portion thereof. 
     
     
         19 . The system of  claim 11 , wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least partially statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core. 
     
     
         20 . The system of  claim 11 , further comprising:
 a signature generator system, wherein each signature is generated by the signature generator system, wherein the signature generator system includes a plurality of at least partially statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.