Methods and systems for reducing latency on collaborative platform

Abstract

Systems and methods for reducing latency on a collaborative platform are provided. The collaborative platform involves a display, a moderator device, one or more member devices, and a receiver in communication with the display, the moderator device, and the one or more member devices. To reduce latency of the collaborative platform, the receiver generates an overlay image based on user input received from the display, as well as user type of the user input, generates an overlaid image based on the overlay image, and transmits the overlaid image for display, while a collaboration application generates new real image(s) based on the user input for display. The overlaid image generated may be indicative of actual user input as well as predicted user input using extrapolation and/or machine learning.

What is claimed: 
     
         1 . A method for reducing latency on a collaborative platform, the method comprising:
 receiving, by a first device, a first image from a third device;   receiving, by the first device, user input data indicative of user input on a second device;   transmitting, by the first device, the user input data to the third device;   determining, by the first device, an overlay image based on the user input data;   determining, by the first device, an overlaid image based on the overlay image and the first image; and   transmitting, by the first device, the overlaid image to the second device to cause the overlaid image to be displayed on the second device.   
     
     
         2 . The method of  claim 1 , wherein determining, by the first device, the overlay image comprises determining, by the first device, a first portion of the overlay image indicative of the user input on the second device based on the user input data. 
     
     
         3 . The method of  claim 2 , wherein determining, by the first device, the overlay image comprises predicting, by the first device, an extended portion of the overlay image based on the user input data. 
     
     
         4 . The method of  claim 3 , wherein predicting, by the first device, the extended portion of the overlay image based on the user input data comprises predicting, by the first device, the extended portion of the overlay image based on at least one of spatial or time coordinates of the user input data. 
     
     
         5 . The method of  claim 3 , wherein predicting, by the first device, the extended portion of the overlay image based on the user input data comprises predicting, by the first device, the extended portion of the overlay image based on a velocity of the user input data. 
     
     
         6 . The method of  claim 3 , wherein the extended portion of the overlay image comprises a curved portion comprising a plurality of finite line segments, and wherein predicting, by the first device, the extended portion of the overlay image comprising predicting the curved portion based on an angle of each finite line segment of the plurality of finite line segments. 
     
     
         7 . The method of  claim 3 , wherein predicting, by the first device, the extended portion of the overlay image based on the user input data comprises predicting, by the first device, the extended portion of the overlay image based on at least one of extrapolation, machine learning, artificial intelligence, or a neural network. 
     
     
         8 . The method of  claim 3 , wherein determining, by the first device, the overlay image comprises determining, by the first device, the overlay image comprising the first and extended portions of the overlay image. 
     
     
         9 . The method of  claim 1 , wherein a portion of the overlay image is displayed on the second device for a predetermined period of time. 
     
     
         10 . The method of  claim 9 , wherein the predetermined period of time is at least as long as the latency on the collaborative platform. 
     
     
         11 . The method of  claim 1 , wherein the overlay image comprises a leading end and a trailing end, such that, as a number of spatial coordinates of the leading end increases on the second device, a portion of spatial coordinates of the trailing end is removed from the second device depending on a length of the latency on a collaborative platform. 
     
     
         12 . The method of  claim 1 , wherein the overlay image comprises a maximum amount of spatial coordinates, such that, when an additional spatial coordinate is displayed that exceeds the maximum amount of spatial coordinates, an initial displayed spatial coordinate is removed from the overlay image. 
     
     
         13 . The method of  claim 1 , wherein the overlay image comprises a leading end, a trailing end, and a maximum spatial length, such that, as the leading end extends, the trailing end is removed to maintain the maximum spatial length of the overlay image of the overlaid image displayed on the second device. 
     
     
         14 . The method of  claim 1 , wherein the overlay image comprises a leading end and a trailing end, such that, as the leading end extends on the second device at a rate, the trailing end is removed from the second device at the rate. 
     
     
         15 . The method of  claim 1 , wherein the overlay image comprises a leading end and a trailing end, such that, as a number of spatial coordinates of the lending end increases on the second device, a portion of spatial coordinates of the trailing end is removed from the second device depending on a speed of the increasing spatial coordinates. 
     
     
         16 . The method of  claim 1 , further comprising determining, by the first device, an input type corresponding to the user input on the second device, wherein the input type comprises at least one of thickness, color, or marker or eraser type. 
     
     
         17 . The method of  claim 16 , wherein determining, by the first device, the input type comprises determining, by the first device, the input type based on the user input data and machine learning. 
     
     
         18 . The method of  claim 1 , further comprising receiving, by the first device, data indicative of an input type corresponding to the user input from the third device. 
     
     
         19 . The method of  claim 18 , wherein receiving, by the first device, data indicative of the input type comprises receiving, by the first device, data indicative of the input type from an application running on the third device via a defined TCP port. 
     
     
         20 . The method of  claim 18 , wherein receiving, by the first device, data indicative of the input type comprises receiving, by the first device, data indicative of the input type from an operating system running on the third device via a user input back channel (UIBC) extension.