US10957050B2ActiveUtilityA1
Decoupled multi-layer render frequency
Est. expiryApr 1, 2037(~10.7 yrs left)· nominal 20-yr term from priority
H04N 19/597G06T 1/20G06T 15/503G06T 19/006G06T 2207/30168H04N 19/132H04N 19/167H04N 21/234318H04N 21/8146G06T 15/205H04N 19/40G06T 15/005H04N 21/00G06T 7/11H04N 21/234381H04N 21/440281H04N 19/587H04N 21/4781H04N 19/46H04N 19/436G06F 3/011G06T 7/194G06T 2219/2008G06T 7/97
82
PatentIndex Score
2
Cited by
51
References
21
Claims
Abstract
Systems, apparatuses and methods may provide for technology that partitions a three-dimensional (3D) scene into a plurality of layers including at least a foreground layer and a background layer. Additionally, the foreground layer may be rendered at a first rate and the background layer may be rendered at a second frame rate, wherein the first frame rate is greater than the second frame rate. In one example, the foreground layer and the background layer are composited into a frame.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1. A display apparatus, the display apparatus comprising:
a first display to show video content to a first eye;
a second display to show the video content to a second eye;
a memory; and
logic coupled to the memory, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer, wherein each of the foreground layer and the background layer include an overdrawn portion with elements outside of a field of view;
render the foreground layer at a first frame rate;
render the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; and
apply an asynchronous time warp to the background layer and the foreground layer, wherein the asynchronous time warp is to be applied based on the overdrawn portion of each layer and at least one of a cursor position change or a head mounted display system pose change.
2. The display apparatus of claim 1 , wherein the plurality of layers includes an intermediate layer, wherein the logic coupled to the memory is further to render the intermediate layer at a third frame rate, and wherein the third frame rate is to be greater than the second frame rate and less than the first frame rate.
3. The display apparatus of claim 2 , wherein the logic coupled to the memory is further to composite the foreground layer, the intermediate layer and the background layer into a frame.
4. The display apparatus of claim 3 , wherein to composite the foreground layer, the intermediate layer and the background layer into a frame includes to upconvert the background layer to the first frame rate.
5. A display apparatus, the display apparatus comprising:
a first display to show video content to a first eye;
a second display to show the video content to a second eye;
a memory; and
logic coupled to the memory, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer;
render the foreground layer at a first frame rate;
render the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate;
upconvert the background layer to the first frame rate;
identify a pending vertical synchronization between the first frame rate and a display refresh rate; and
apply an asynchronous time warp to the background layer and the foreground layer prior to the vertical synchronization.
6. The display apparatus of claim 5 , wherein the first display and the second display constitute a head mounted display and the asynchronous time warp is to be applied based on a pose change associated with the head mounted display.
7. The display apparatus of claim 5 , wherein the asynchronous time warp is to be applied based on a cursor position change.
8. A method comprising:
partitioning a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer, wherein each of the foreground layer and the background layer include an overdrawn portion with elements outside of a field of view;
rendering the foreground layer at a first frame rate;
rendering the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; and
applying an asynchronous time warp to the background layer and the foreground layer, wherein the asynchronous time warp is applied based on the overdrawn portion of each layer and at least one of a cursor position change or a head mounted display system pose change.
9. The method of claim 8 , wherein the plurality of layers includes an intermediate layer, and further comprising rendering the intermediate layer at a third frame rate, the third frame rate being greater than the second frame rate and less than the first frame rate.
10. The method of claim 9 , further comprising compositing the foreground layer, the intermediate layer and the background layer into a frame.
11. The method of claim 10 , wherein compositing the foreground layer, the intermediate layer and the background layer into a frame includes upconverting the background layer to the first frame rate.
12. A method comprising:
partitioning a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer;
rendering the foreground layer at a first frame rate;
rendering the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate;
upconverting the background layer to the first frame rate;
identifying a pending vertical synchronization between the first frame rate and a display refresh rate; and
applying an asynchronous time warp to the background layer and the foreground layer prior to the vertical synchronization.
13. The method of claim 12 , wherein the asynchronous time warp is applied based on a head mounted display system pose change.
14. The method of claim 12 , wherein the asynchronous time warp is applied based on a cursor position change.
15. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer, wherein each of the foreground layer and the background layer include an overdrawn portion with elements outside of a field of view;
render the foreground layer at a first frame rate;
render the background layer at a second frame rate, wherein the first frame rate is to be greater than the second frame rate; and
apply an asynchronous time warp to the background layer and the foreground layer, wherein the asynchronous time warp is to be applied based on the overdrawn portion of each layer and at least one of a cursor position change or a head mounted display system pose change.
16. The at least one non-transitory computer readable storage medium of claim 15 , wherein the plurality of layers includes an intermediate layer, and wherein the instructions, when executed by the computing system, further cause the computing system to render the intermediate layer at a third frame rate, the third frame rate to be greater than the second frame rate and less than the first frame rate.
17. The at least one non-transitory computer readable storage medium of claim 16 , wherein the instructions, when executed by the computing system, further cause the computing system to composite the foreground layer, the intermediate layer and the background layer into a frame.
18. The at least one non-transitory computer readable storage medium of claim 17 , wherein to composite the foreground layer, the intermediate layer and the background layer into a frame includes to upconvert the background layer to the first frame rate.
19. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
partition a three-dimensional (3D) scene of the video content into a plurality of layers including at least a foreground layer and a background layer;
render the foreground layer at a first frame rate;
render the background layer at a second frame rate, wherein the first frame rate is greater than the second frame rate;
upconvert the background layer to the first frame rate;
identify a pending vertical synchronization between the first frame rate and a display refresh rate; and
apply an asynchronous time warp to the background layer and the foreground layer prior to the vertical synchronization.
20. The at least one non-transitory computer readable storage medium of claim 19 , wherein the asynchronous time warp is to be applied based on a head mounted display system pose change.
21. The at least one non-transitory computer readable storage medium of claim 19 , wherein the asynchronous time warp is to be applied based on a cursor position change.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.