Latency-dependent cloud input channel management

Abstract

Aspects of the present disclosure relate to systems and methods for establishing an assistance output that takes into account client device latency information and sending the assistance output from the server to the client device. Client device information or the assistance output may include a stream of encrypted data packets.

What is claimed is: 
     
       1. In a server configured to operate on a network, a method, comprising:
 receiving client device information from a client device with the server via a network connection, wherein the client device information includes client latency data; 
 determining an assistance output that takes into account the client latency data including generating an assistance output based on data that includes a measurement of time between user inputs generated at a client device, wherein determining the assistance output includes utilizing the input time measurements wherein the assistance output utilizes the measurement of time between user inputs to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein determining the assistance output comprises at least choosing the appropriate assistance output based on client latency data, wherein the assistance output is configured to alter a modality of user experience with the client device; and 
 sending the assistance output from the server to the client device, wherein the assistance output allows the user to overcome the effects of latency. 
 
     
     
       2. The method of  claim 1 , wherein the assistance output contains a signal that triggers execution of assistance instructions already loaded on the client device. 
     
     
       3. The method of  claim 1 , wherein the assistance output contains instructions to be executed on the client device. 
     
     
       4. The method of claim  2  3, wherein the instructions are scripts. 
     
     
       5. The method of claim  3  4, wherein the scripts are configured to aid the user in the completion of a task. 
     
     
       6. The method of  claim 1 , wherein the modality is altered by allowing more time for user input. 
     
     
       7. The method of  claim 1 , wherein the modality is altered by reducing a difficulty level of an artificial intelligence asset engaging the user. 
     
     
       8. The method of  claim 1 , wherein the modality is altered by presenting a different scene to the user. 
     
     
       9. The method of  claim 1 , wherein the client device information or the assistance output includes a stream of encrypted data packets. 
     
     
       10. The method of  claim 9 , wherein each data packet in the stream of encrypted data packets includes a header that indicates a place in a decryption order for the packet. 
     
     
       11. The method of  claim 10 , further comprising using the decryption order of the encrypted packets to reassemble the data stream with the server when the packets are received out of order. 
     
     
       12. The method of  claim 9 , wherein the stream of data packets is sent via an unreliable protocol. 
     
     
       13. The method of  claim 12 , wherein the unreliable protocol is User Datagram Protocol (UDP). 
     
     
       14. A system comprising:
 a processor, and 
 a memory coupled to the processor; 
 
       wherein the processor is configured to perform a method, the method comprising:
 receiving client device information from a client device with a server via a network connection, wherein the client device information includes client latency data; 
 determining an assistance output that takes into account the client latency data, wherein determining the assistance output comprises at least choosing the appropriate generating an assistance output based on client latency data including that includes a measurement of time between user inputs generated at a client device, wherein determining the assistance output includes utilizing utilizes the input time measurements measurement of time between user inputs to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and 
 
       sending the assistance output from the server to the client device, wherein the assistance output allows the user to overcome the effects of latency. 
     
     
       15. The system of  claim 14 , wherein the client device information or the assistance output includes a stream of encrypted data packets. 
     
     
       16. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising:
 receiving client device information from a client device with a server via a network connection, wherein the client device information includes client latency data 
 determining an assistance output that takes into account the client latency data, wherein determining the assistance output comprises at least choosing the appropriate assistance output based on client latency data includinggenerating an assistance output based client latency data that includes a measurement of time between user inputs, wherein determining the assistance output includes utilizingwherein the assistance output utilizes the input time measurementsmeasurement of time between user inputs to implement the inputs with the server using the same input time measurementsdifferences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and 
 sending the assistance output from the server to the client device, wherein the assistance output allows the user to overcome the effects of latency. 
 
     
     
       17. The non-transitory computer readable medium of  claim 16 , wherein the client device information or the assistance output includes a stream of encrypted data packets. 
     
     
       18. A method comprising:
 sending client device information from a client device to a server via a network connection, wherein the client device information includes client latency data a measurement of time between user inputs; 
 receiving an assistance output from the server, wherein the assistance output takes into account the client latency data including a measurement of time between user inputs, wherein the assistance output is chosen based at least on the client latency data, wherein choosing the assistance output includes utilizing utilizes the input time measurements measurement of time between user to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and 
 
       implementing assistance corresponding to the assistance output with the client device, wherein the assistance output allows the user to overcome the effects of latency. 
     
     
       19. The method of  claim 18 , wherein the assistance output contains a signal that triggers execution of assistance instructions already loaded on the client device. 
     
     
       20. The method of  claim 18 , wherein the assistance output contains instructions to be executed on the client device. 
     
     
       21. The method of claim  19  20, wherein the instructions are scripts. 
     
     
       22. The method of claim  20  21, wherein the scripts are configured to aid the user in the completion of a task. 
     
     
       23. The method of  claim 18 , wherein the modality is altered by allowing more time for user input. 
     
     
       24. The method of  claim 18 , wherein the modality is altered by reducing a difficulty level of an artificial intelligence asset engaging the user. 
     
     
       25. The method of  claim 18 , wherein the modality is altered by presenting a different scene to the user. 
     
     
       26. The method of  claim 18 , wherein the client device information or the assistance output includes a stream of encrypted data packets. 
     
     
       27. The method of  claim 26 , wherein each data packet in the stream of encrypted data packets includes a header that indicates a place in a decryption order for the packet. 
     
     
       28. The method of  claim 27 , further comprising using the decryption order of the encrypted packets to reassemble the data stream with the server when the packets are received out of order. 
     
     
       29. The method of  claim 26 , wherein the stream of data packets is sent via an unreliable protocol. 
     
     
       30. The method of  claim 29 , wherein the unreliable protocol is User Datagram Protocol (UDP). 
     
     
       31. A system comprising:
 a processor, and 
 a memory coupled to the processor; 
 
       wherein the processor is configured to perform a method, the method comprising:
 sending client device information from a client device to a server via a network connection, wherein the client device information includes client latency data a measurement of time between user inputs; 
 receiving an assistance output from the server, wherein the assistance output takes into account the client device latency information including a measurement of time between user inputs, wherein the assistance output is chosen based at least in part on the client latency information, wherein choosing the assistance output includes utilizing the input time measurements measurement of time between user inputs to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and 
 
       implementing assistance corresponding to the assistance output with the client device, wherein the assistance output allows the user to overcome the effects of latency. 
     
     
       32. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising:
 sending client device information from a client device to a server via a network connection, wherein the client device information includes client latency data a measurement of time between user inputs; 
 receiving an assistance output from the server wherein the assistance output takes into account the client device latency information including a measurement of time between user inputs, wherein the assistance output is chosen based at least on the client latency information, wherein choosing the assistance output includes utilizing the input time measurements measurement of time between user inputs to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and 
 
       implementing assistance corresponding to the assistance output with the client device, wherein the assistance output allows the user to overcome the effects of latency.