Systems and methods for deferred post-processes in video encoding

Abstract

Systems and methods for deferring post-process effects in video encoding are disclosed. The systems and methods are capable of calculating the capability of client hardware to defer load, and summing a known load of one or more deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware. The systems and methods are also capable of sending an updated deferral list of post-processes to a remote server that can apply the list of deferred post-process candidates during the post-processing phase of a first video frame.

The invention claimed is: 
     
       1. A computer-implemented method for deferring post-processes comprising the steps of:
 transmitting an instruction to a client application to measure client hardware capability; and 
 transmitting an instruction to a client application to sum a known load of one or more predetermined post-process deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware, 
 wherein a post-process deferral list is compiled, 
 wherein the post-process deferral list is built in reverse order, 
 wherein a server receives the post-process deferral list, skips the list of deferred post-processes during the post-processing phase of a first video frame, and transmits an instruction to a client application to render an image, and 
 wherein the post-process deferral list is added to a benchmarking process. 
 
     
     
       2. The method of  claim 1 , wherein the client application re-measures the capability of the client hardware in response to one or more environmental changes. 
     
     
       3. The method of  claim 2 , wherein the client application performs a callback or polls one or more operating system events to determine whether to re-measure the capability of the client hardware. 
     
     
       4. The method of  claim 1 , wherein the client application evaluates how many post-process deferral candidates are capable of being deferred to the client hardware by measuring frame rate and/or resource usage. 
     
     
       5. The method of  claim 1 , wherein the server applies the updated deferral list to a next available video frame. 
     
     
       6. The method of  claim 1 , further comprising the step of the server transmitting encoded video data to the client application without metadata associated with post-processes. 
     
     
       7. The method of  claim 1 , wherein the capability of the client hardware is measured by detecting available instruction sets, memory, CPU, and/or GPU characteristics. 
     
     
       8. The method of  claim 1 , wherein the list of post-process deferral candidates is recalculated based on changes to the client hardware's battery state. 
     
     
       9. The method of  claim 1 , wherein the server returns the first or next available video frame to the client application with a metadata flag. 
     
     
       10. A system for deferring post-process, wherein over a network, a server:
 transmits an instruction to a client application to measure client hardware capability; and 
 transmits an instruction to a client application to sum a known load of one or more predetermined post-process deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware, 
 wherein a post-process deferral list is compiled, 
 wherein the post-process deferral list is built in reverse order, 
 wherein a server receives the post-process deferral list, skips the list of deferred post-processes during the post-processing phase of a first video frame, and transmits an instruction to a client application to render an image, and 
 wherein the post-process deferral list is added to a benchmarking process. 
 
     
     
       11. The system of  claim 10 , wherein the client application re-measures the capability of the client hardware in response to one or more environmental changes. 
     
     
       12. The system of  claim 11 , wherein the client application performs a callback or polls one or more operating system events to determine whether to re-measure the capability of the client hardware. 
     
     
       13. The system of  claim 10 , wherein the client application evaluates how many post-process deferral candidates are capable of being deferred to the client hardware by measuring frame rate and/or resource usage. 
     
     
       14. The system of  claim 10 , wherein the server applies the updated list of post-process deferral candidates to a next available video frame. 
     
     
       15. The system of  claim 10 , wherein the server transmits encoded video data to the client application without metadata associated with post-processes. 
     
     
       16. The system of  claim 10 , wherein the capability of the client hardware is measured by detecting available instruction sets, memory, CPU, and/or GPU characteristics. 
     
     
       17. The system of  claim 10 , wherein the list of post-process deferral candidates is recalculated based on changes to the client hardware's battery state. 
     
     
       18. The system of  claim 10 , wherein the server returns the first or next available video frame to the client application with a metadata flag.