System and method for visual analysis of on-image gestures

Abstract

A method and system for providing at least a link to a content item related to a multimedia content element respective of an on-image gesture. The method comprises receiving, from a user device, at least on-image gesture and the multimedia content element; analyzing the at least on-image gesture determine at least one portion of the multimedia content element that a user is interested in; generating at least one signature for each of the at least a portion; determining a content item corresponding to the at least one identified portion of multimedia content, wherein the determination is based in part on a type of the at least on-image gesture; and modifying the received multimedia content element to include at least a link to an informative resource containing the content item.

1 . A method for providing at least one link to a content item related to a multimedia content element in response to an on-image gesture, comprising:
 receiving, from a user device, at least the on-image gesture and an indication of the multimedia content element, the multimedia content element being initially non-interactive;   analyzing the at least on-image gesture to identify at least one portion of the multimedia content element in which a user is interested;   generating at least one signature for each of the identified at least one portion;   determining a content item corresponding to the at least one portion of the multimedia content element, wherein the determination is based at least on a type of the at least on-image gesture and the at least one signature; and   modifying the multimedia content element to include at least a link to an informative resource containing the content item, thereby making the multimedia content element interactive.   
     
     
         2 . The method of  claim 1 , further comprising: receiving at least one event related to the multimedia content element; and wherein determining the content item corresponding to the at least one identified portion of multimedia content is further based on the at least one event. 
     
     
         3 . The method of  claim 1 , wherein an on-image gesture is any one of: a touch gesture, a scroll-over, a mouse click, wherein the touch gesture is detected on a user device having a touch screen display. 
     
     
         4 . The method of  claim 1 , wherein the at least one event is at least one of viewing the multimedia content element for a specified period of time and interacting with the multimedia content element for a specified period of time. 
     
     
         5 . The method of  claim 2 , further comprising: determining a type of the on-image gesture and a type of the at least one event; and determining a type of the content item based on at least one of: the type of the on-image gesture and the type of the at least one event. 
     
     
         6 . The method of  claim 1 , further comprising: determining a context of the multimedia content element based on the generated signature; and determining the content item based on the context of the multimedia content element respective of the generated signature. 
     
     
         7 . The method of  claim 1 , wherein any one of the multimedia content element and the content item is at least one of: an image, graphics, a video stream, a video clip, an audio stream, an audio clip, a video frame, a photograph, images of signals, combinations thereof, and portions thereof. 
     
     
         8 . The method of  claim 1 , wherein the at least one link is added to the multimedia content element as an overlay object, wherein the modified multimedia content is embedded in a web page displayed in a web-browser of the user device. 
     
     
         9 . The method of  claim 8 , wherein the overlay object comprises a vocabulary of at least one on-image gesture determined as corresponding to the at least one identified portion of the multimedia content element. 
     
     
         10 . The method according to  claim 1  wherein the multimedia content element is an image that is included in a web page. 
     
     
         11 . The method according to  claim 1  wherein the at least one signature represents a response of at least one neural network to each of the identified at least one portion. 
     
     
         12 . The method according to  claim 1  comprising generating the at least one signature by a plurality of mutually independent computational cores. 
     
     
         13 . The method according to  claim 1  wherein the steps of (a) analyzing, (b) generating, (c) determining, and (d) modifying are executed by a server; and wherein the method comprises sending to the user device, the multimedia content element that includes at least the link to an informative resource containing the content item. 
     
     
         14 . A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute the method according to  claim 1 . 
     
     
         15 . A system for providing at least a link to a content item related to a multimedia content element in response to a user gesture, comprising:
 an interface to a network for receiving a uniform resource locator (URL) of a web-page containing a multimedia content element and at least on-image gesture related to the multimedia content element;   a processor; and   a memory coupled to the processor,   the memory contains instructions that when executed by the processor cause the system to:   receive, from a user device, the at least on-image gesture and the multimedia content element, the multimedia content element being initially non-interactive;   analyze the at least on-image gesture to identify at least one portion of the multimedia content element in which a user is interested;   generate at least one signature for each of the identified at least one portion;   determine a content item corresponding to the identified at least one portion of the multimedia content element, wherein the determination is based at least on a type of the at least on-image gesture and the at least one signature; and   modify the multimedia content element to include at least a link to an informative resource containing the content item, thereby making the multimedia content element interactive.   
     
     
         16 . The system of  claim 15 , wherein the system is further configured to: receive at least one event related to the multimedia content element; and the content item corresponding to the at least one identified portion of multimedia content is determined also using the at least one event. 
     
     
         17 . The system of  claim 16 , wherein the on-image gesture is any one of: a touch gesture, a scroll-over, a mouse click, wherein the touch gesture is detected on a user device having a touch screen display. 
     
     
         18 . The system of  claim 16 , wherein the at least one event is at least one of viewing the multimedia content element for a specified period of time and interacting with the multimedia content element for a specified period of time. 
     
     
         19 . The system of  claim 16 , wherein the system is further configured to: determine a type of the on-image gesture and a type of the at least one event; and determine a type of the content item based on at least one of: the type of the on-image gesture and the type of the at least one event. 
     
     
         20 . The system of  claim 16 , wherein the system is further configured to: determine a context of the multimedia content element based on the generated signature; and determine the content item based on the context of the multimedia content element respective of the generated signature. 
     
     
         21 . The system of  claim 15 , wherein any one of the multimedia content elements and the content item is at least one of: an image, graphics, a video stream, a video clip, an audio stream, an audio clip, a video frame, a photograph, images of signals, combinations thereof, and portions thereof. 
     
     
         22 . The system of  claim 15 , wherein the at least one link is added to the multimedia content element as an overlay object, wherein the modified multimedia content is embedded in a web page displayed in a web-browser of the user device. 
     
     
         23 . The system of  claim 22 , wherein the overlay object comprises a vocabulary of the at least one on-image gesture determined as corresponding to the at least one identified portion of the multimedia content element.