Systems and methods for controlling a device via gestures received by a remote device

Abstract

A method and system for sharing a user interface of a first device with a second device and enabling a user of the second device to interact with the user interface via gestures received by the second device. The first device (e.g., a smartphone) can host an application and generate a graphical user interface, which it transmits to the second device (e.g., a tablet computer) for display by the second device. The second device can receive input from a user, such as a touch input via a touchscreen of the second device, and transmit a representation of the input to the first device for providing input to the application hosted by the first device.

I/We claim: 
     
         1 . A method performed by a first computing device, the method comprising:
 cataloging interface elements of a graphical user interface displayed on the first computing device;   transmitting video of the graphical user interface to a second computing device, the video causing the display of the graphical user interface on the second computing device;   receiving a representation of a gesture of a user on the second computing device, wherein:
 the gesture is with respect to the graphical user interface displayed on the second computing device, and 
 the representation of the gesture is transformed to reflect a difference between the graphical user interface displayed on the second computing device and the graphical user interface displayed on the first computing device; 
   comparing the received gesture representation to the cataloged interface elements;   identifying an interface element of the cataloged interface elements that is implicated by the received gesture representation, wherein the identified interface element is associated with a function; and   executing the function associated with the identified interface element on the first computing device.