US10957050B2ActiveUtilityA1

Decoupled multi-layer render frequency

82
Assignee: INTEL CORPPriority: Apr 1, 2017Filed: Nov 19, 2019Granted: Mar 23, 2021
Est. expiryApr 1, 2037(~10.7 yrs left)· nominal 20-yr term from priority
H04N 19/597G06T 1/20G06T 15/503G06T 19/006G06T 2207/30168H04N 19/132H04N 19/167H04N 21/234318H04N 21/8146G06T 15/205H04N 19/40G06T 15/005H04N 21/00G06T 7/11H04N 21/234381H04N 21/440281H04N 19/587H04N 21/4781H04N 19/46H04N 19/436G06F 3/011G06T 7/194G06T 2219/2008G06T 7/97
82
PatentIndex Score
2
Cited by
51
References
21
Claims

Abstract

Systems, apparatuses and methods may provide for technology that partitions a three-dimensional (3D) scene into a plurality of layers including at least a foreground layer and a background layer. Additionally, the foreground layer may be rendered at a first rate and the background layer may be rendered at a second frame rate, wherein the first frame rate is greater than the second frame rate. In one example, the foreground layer and the background layer are composited into a frame.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A display apparatus, the display apparatus comprising:
 a first display to show video content to a first eye; 
 a second display to show the video content to a second eye; 
 a memory; and 
 logic coupled to the memory, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
 partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer, wherein each of the foreground layer and the background layer include an overdrawn portion with elements outside of a field of view; 
 render the foreground layer at a first frame rate; 
 render the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; and 
 apply an asynchronous time warp to the background layer and the foreground layer, wherein the asynchronous time warp is to be applied based on the overdrawn portion of each layer and at least one of a cursor position change or a head mounted display system pose change. 
 
 
     
     
       2. The display apparatus of  claim 1 , wherein the plurality of layers includes an intermediate layer, wherein the logic coupled to the memory is further to render the intermediate layer at a third frame rate, and wherein the third frame rate is to be greater than the second frame rate and less than the first frame rate. 
     
     
       3. The display apparatus of  claim 2 , wherein the logic coupled to the memory is further to composite the foreground layer, the intermediate layer and the background layer into a frame. 
     
     
       4. The display apparatus of  claim 3 , wherein to composite the foreground layer, the intermediate layer and the background layer into a frame includes to upconvert the background layer to the first frame rate. 
     
     
       5. A display apparatus, the display apparatus comprising:
 a first display to show video content to a first eye; 
 a second display to show the video content to a second eye; 
 a memory; and 
 logic coupled to the memory, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
 partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer; 
 render the foreground layer at a first frame rate; 
 
 render the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate;
 upconvert the background layer to the first frame rate; 
 identify a pending vertical synchronization between the first frame rate and a display refresh rate; and 
 apply an asynchronous time warp to the background layer and the foreground layer prior to the vertical synchronization. 
 
 
     
     
       6. The display apparatus of  claim 5 , wherein the first display and the second display constitute a head mounted display and the asynchronous time warp is to be applied based on a pose change associated with the head mounted display. 
     
     
       7. The display apparatus of  claim 5 , wherein the asynchronous time warp is to be applied based on a cursor position change. 
     
     
       8. A method comprising:
 partitioning a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer, wherein each of the foreground layer and the background layer include an overdrawn portion with elements outside of a field of view; 
 rendering the foreground layer at a first frame rate; 
 rendering the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; and 
 applying an asynchronous time warp to the background layer and the foreground layer, wherein the asynchronous time warp is applied based on the overdrawn portion of each layer and at least one of a cursor position change or a head mounted display system pose change. 
 
     
     
       9. The method of  claim 8 , wherein the plurality of layers includes an intermediate layer, and further comprising rendering the intermediate layer at a third frame rate, the third frame rate being greater than the second frame rate and less than the first frame rate. 
     
     
       10. The method of  claim 9 , further comprising compositing the foreground layer, the intermediate layer and the background layer into a frame. 
     
     
       11. The method of  claim 10 , wherein compositing the foreground layer, the intermediate layer and the background layer into a frame includes upconverting the background layer to the first frame rate. 
     
     
       12. A method comprising:
 partitioning a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer; 
 rendering the foreground layer at a first frame rate; 
 rendering the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; 
 upconverting the background layer to the first frame rate; 
 identifying a pending vertical synchronization between the first frame rate and a display refresh rate; and 
 applying an asynchronous time warp to the background layer and the foreground layer prior to the vertical synchronization. 
 
     
     
       13. The method of  claim 12 , wherein the asynchronous time warp is applied based on a head mounted display system pose change. 
     
     
       14. The method of  claim 12 , wherein the asynchronous time warp is applied based on a cursor position change. 
     
     
       15. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
 partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer, wherein each of the foreground layer and the background layer include an overdrawn portion with elements outside of a field of view; 
 render the foreground layer at a first frame rate; 
 render the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; and 
 apply an asynchronous time warp to the background layer and the foreground layer, wherein the asynchronous time warp is to be applied based on the overdrawn portion of each layer and at least one of a cursor position change or a head mounted display system pose change. 
 
     
     
       16. The at least one non-transitory computer readable storage medium of  claim 15 , wherein the plurality of layers includes an intermediate layer, and wherein the instructions, when executed by the computing system, further cause the computing system to render the intermediate layer at a third frame rate, the third frame rate to be greater than the second frame rate and less than the first frame rate. 
     
     
       17. The at least one non-transitory computer readable storage medium of  claim 16 , wherein the instructions, when executed by the computing system, further cause the computing system to composite the foreground layer, the intermediate layer and the background layer into a frame. 
     
     
       18. The at least one non-transitory computer readable storage medium of  claim 17 , wherein to composite the foreground layer, the intermediate layer and the background layer into a frame includes to upconvert the background layer to the first frame rate. 
     
     
       19. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
 partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer; 
 render the foreground layer at a first frame rate; 
 render the background layer at a second frame rate, wherein the first frame rate is greater than the second frame rate; 
 upconvert the background layer to the first frame rate; 
 identify a pending vertical synchronization between the first frame rate and a display refresh rate; and 
 apply an asynchronous time warp to the background layer and the foreground layer prior to the vertical synchronization. 
 
     
     
       20. The at least one non-transitory computer readable storage medium of  claim 19 , wherein the asynchronous time warp is to be applied based on a head mounted display system pose change. 
     
     
       21. The at least one non-transitory computer readable storage medium of  claim 19 , wherein the asynchronous time warp is to be applied based on a cursor position change.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.