Method and apparatus for using gestures across multiple devices

Abstract

Method and apparatus for implementing gestures across user interface display apparatuses, including detecting and saving, at a first user interface display apparatus, an initial user input; determining whether the initial user input is within a predetermined proximity to a boundary with a second user interface display apparatus; detecting and saving additional user input continuing from the initial user input; when the initial user input is within the predetermined proximity, incorporating additional information from a transition message received within a predetermined time period from the second user interface display apparatus to the saved user input, the predetermined time period corresponding to a message time between the first and second user interface display apparatuses from a time of the initial user input; and implementing the saved user input on one or more of the first and second user interface display apparatuses.

1 . A method for implementing a user's single gesture across a plurality of user interface display apparatuses, comprising:
 detecting and saving, at a first user interface display apparatus, an initial user single input;   determining whether the initial user single input s within a predetermined proximity to a boundary with a second user interface display apparatus;   detecting and saving additional user input, which corresponds to the initial user single input continuing from the initial user single input across the boundary between the first and second user interface display apparatuses;   when the initial user single input is within the predetermined proximity of the boundary with the second user interface display apparatus, incorporating in the saved additional user input a transition information message received within a predetermined time period from the second user interface display apparatus, the predetermined time period corresponding to a message time between the first and second user interface display apparatuses from a time of the initial user single input; and   implementing the saved additional user input on at least the second user interface display apparatus.   
     
     
         2 . The method of  claim 1 , further comprising:
 detecting an end to the additional user input;   determining whether the end to the additional user input is within the predetermined proximity to the boundary with the second user interface display apparatus; and   when the end to the additional user input is within the predetermined proximity, transmitting a user input transition message to the second user interface display apparatus.   
     
     
         3 . The method of  claim 1 , further comprising:
 detecting an end to the additional user input;   determining whether the end to the additional user input is within the predetermined proximity to an additional boundary with a third user interface display apparatus; and   when the end to the additional user input is within the predetermined proximity to the additional boundary with the third user interface display apparatus, transmitting a user input transition message to the third user interface display apparatus.   
     
     
         4 . The method of  claim 3 , wherein said implementing is performed on one or more of the first, second, and third user interface display apparatuses. 
     
     
         5 . The method of  claim 1 , wherein said incorporating further comprises updating a server with the saved additional user input. 
     
     
         6 . The method of  claim 1 , wherein the saved additional user input corresponds to an identification and a move of one or more displayed objects on one or more of the first and second user interface display apparatuses. 
     
     
         7 . The method of  claim 1 , wherein the saved additional user input corresponds to scrolling a shared workspace or document that is displayed on the first and second user interface display apparatuses. 
     
     
         8 . The method of  claim 1 , wherein the saved additional user input corresponds to inking a shared document that is displayed on the first and second user interface display apparatuses. 
     
     
         9 . A program embodied in a non-transitory computer eadable medium for implementing a user's single gesture across a plurality of user interface display apparatuses, said program comprising instructions to perform:
 detecting and saving, at a first user interface display apparatus, an initial user single input;   determining whether the initial user single input is within a predetermined proximity to a boundary with a second user interface display apparatus;   detecting and saving additional user input, which corresponds to the initial user single input continuing from the initial user single input across the boundary between the first and second user interface display apparatuses;   when the initial user single input is within the predetermined proximity of the boundary with the second user interface display apparatus, incorporating in the saved additional user input a transition information message received within a predetermined time period from the second user interface display apparatus, the predetermined time period corresponding to a message time between the first and second user interface display apparatuses from a time of the initial user single input; and   implementing the saved additional user input on at least the second user interface display apparatus.   
     
     
         10 . The program of  claim 9 , further comprising instructions to perform:
 detecting an end to the additional user input;   determining whether the end to the additional user input is within the predetermined proximity to the boundary with the second user interface display apparatus; and   when the end to the additional user input is within the predetermined proximity, transmitting a user input transition message to the second user interface display apparatus.   
     
     
         11 . The program of  claim 9 , further comprising instructions to perform:
 detecting an end to the additional user input;   determining whether the end to the additional user input is within the predetermined proximity to an additional boundary with a third user interface display apparatus; and   when the end to the additional user input is within the predetermined proximity to the additional boundary with the third user interface display apparatus, transmitting a user input transition message to the third user interface display apparatus.   
     
     
         12 . The program of  claim 11 , wherein said implementing is performed on one or more of the first, second, and third user interface display apparatuses. 
     
     
         13 . The program of  claim 9 , wherein said incorporating further comprises updating a server with the saved additional user input. 
     
     
         14 . The program of  claim 9 , wherein the saved additional user input corresponds to an identification and a move of one or more displayed objects on one or more of the first and second user interface display apparatuses. 
     
     
         15 . The program of  claim 9 , wherein the saved additional user input corresponds to scrolling a shared workspace or document that is displayed on the first and second user interface display apparatuses. 
     
     
         16 . The program of  claim 9 , wherein the saved additional user input corresponds to inking a shared document that is displayed on the first and second user interface display apparatuses. 
     
     
         17 . A user interface display apparatus for implementing a user's single gesture across a plurality of user interface display apparatuses, comprising:
 a display apparatus;   one or more user interface apparatuses;   memory; and   one or more processors configured to execute one or more programs stored on the memory, said one or more programs comprising instructions to perform:
 detecting, at the one or more user interface apparatuses, an initial user single input; 
 saving the initial user single input; 
 determining whether the initial user input is within a predetermined proximity to a boundary of the display apparatus with a second user interface display apparatus; 
 detecting and saving additional user input, which corresponds to the initial user single input continuing from the initial user single input across the boundary between the first and second user interface display apparatuses; 
 when the initial user single input is within the predetermined proximity of the boundary with the second user interface display apparatus, incorporating in the saved additional user input a transition information message received within a predetermined time period from the second user interface display apparatus, the predetermined time period corresponding to a message time between the user interface display apparatus and the second user interface display apparatus from a time of the initial user single input; and 
   implementing the saved additional user input on at least the second user interface display apparatus.   
     
     
         18 . The user interface display apparatus of  claim 17 , wherein said one or more programs further comprises instructions to perform:
 detecting an end to the additional user input;   determining whether the end to the additional user input is within the predetermined proximity to the boundary of the display apparatus with the second user interface display apparatus; and   when the end to the additional user input is within the predetermined proximity, transmitting a user input transition message to the second user interface display apparatus.   
     
     
         19 . The user interface display apparatus of  claim 17 , wherein said one or more programs further comprises instructions to perform:
 detecting an end to the additional user input;   determining whether the end to the additional user input is within the predetermined proximity to another boundary of the display apparatus with a third user interface display apparatus; and   when the end to the additional user input is within the predetermined proximity to the additional boundary of the display apparatus with the third user interface display apparatus, transmitting a user input transition message to the third user interface display apparatus.   
     
     
         20 . The user interface display apparatus of  claim 19 , wherein said implementing is performed in cooperation with one or more of the second and third user interface display apparatuses. 
     
     
         21 . The user interface display apparatus of  claim 17 , wherein said incorporating further comprises updating a server with the saved additional user input. 
     
     
         22 . The user interface display apparatus of  claim 17 , wherein the saved additional user input corresponds to an identification and a move of one or more displayed objects on one or more of the display apparatus and the second user interface display apparatus. 
     
     
         23 . The user interface display apparatus of  claim 17 , wherein the saved additional user input corresponds to scrolling a shared workspace or document that is displayed on the display apparatus and the second user interface display apparatus. 
     
     
         24 . The user interface display apparatus of  claim 17 , wherein the saved additional user input corresponds to inking a shared document that is displayed on the display apparatus and the second user interface display apparatus. 
     
     
         25 . The method of  claim 1 , wherein the first and second user interface display apparatuses are separate devices which communicate with each other through a server. 
     
     
         26 . The program of  claim 9 , wherein the first and second user interface display apparatuses are separate devices which communicate with each other through a server. 
     
     
         27 . The user interface display apparatus of  claim 17 , wherein the first and second user interface display apparatuses are separate devices which communicate with each other through a server.