Managing multi-modal rendering of application content
Abstract
A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for display. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . A method, comprising:
receiving content, provided by an application running on a device; determining that the content corresponds to two-dimensional content; identifying a portion of the two-dimensional content for enhancement by a three-dimensional render; enhancing, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer; compositing a pass-through video stream with at least the rendered enhanced portion of the two-dimensional content; and providing for display of the rendered enhanced portion of the two-dimensional content composited with the pass-through video stream on a display of the device.
2 . The method of claim 1 , wherein enhancing the identified portion of the two-dimensional content further comprises rendering the enhanced identified portion of the two-dimensional content and the method further comprising:
rendering, by a two-dimensional renderer that is separate from the three-dimensional renderer, another portion of the two-dimensional content; and providing for display of the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content on the display of the device.
3 . The method of claim 1 , wherein the application was compiled for display of content in a two-dimensional display mode.
4 . The method of claim 1 , wherein the content is declaratively defined.
5 . The method of claim 4 , wherein the content is declaratively defined based at least in part on a layer tree and identifying the portion of the two-dimensional content for enhancement by the three-dimensional render further comprises:
determining that a layer of the layer tree comprises a particular flag that identifies the layer for enhancement.
6 . The method of claim 1 , wherein the content for enhancement comprises a particular visual effect associated with one or more attributes, and enhancing, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer comprises rendering a three-dimensional version of the particular visual effect based on the one or more attributes.
7 . The method of claim 6 , wherein the particular visual effect comprises a blur effect, and the one or more attributes comprise at least one of a size or a depth of the blur effect.
8 . The method of claim 1 , wherein the identified portion of the two-dimensional content for enhancement comprises text content, and the method further comprises:
serializing the text content into a format for processing by a graphics processing unit; passing the serialized text content to the graphics processing unit; and receiving, from the graphics processing unit, a vector graphics based version of the text content.
9 . The method of claim 8 , wherein providing for display of the rendered enhanced portion of the two-dimensional content on the display of the device comprises:
providing for display of the vector graphics based version of the text content in a manner that is perspective correct with respect to a user of the device.
10 . The method of claim 1 , wherein enhancing the two-dimensional content comprises transforming a predefined two-dimensional user interface element included in the two-dimensional content to a corresponding three-dimensional user interface element.
11 . The method of claim 1 , wherein enhancing the two-dimensional content comprises performing at least one of compositing or lens correction with respect to the two-dimensional content, based on specifications of the display.
12 . The method of claim 1 , wherein enhancing the portion of the two-dimensional content comprises converting the portion of the two-dimensional content from a monoscopic video format to a stereoscopic video format.
13 . A device, comprising:
at least one processor; and a memory including instructions that, when executed by the at least one processor, cause the at least one processor to:
receive content, provided by an application running on a device;
determine that the content corresponds to two-dimensional content;
identify a portion of the two-dimensional content for enhancement by a three-dimensional render;
enhance the portion of the two-dimensional content by the three-dimensional renderer;
render, by a two-dimensional renderer that is separate from the three-dimensional renderer, another portion of the two-dimensional content; and
provide for display of the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content on a display of the device.
14 . The device of claim 13 , wherein the at least one processor is further configured to:
composite a pass-through video stream with the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content.
15 . The device of claim 13 , wherein the application was compiled for display of content in a two-dimensional display mode.
16 . The device of claim 13 , wherein the content is declaratively defined.
17 . The device of claim 16 , wherein the content is declaratively defined based at least in part on a layer tree and identifying the portion of the two-dimensional content for enhancement by the three-dimensional render further comprises:
determining that a layer of the layer tree comprises a particular flag that identifies the layer for enhancement.
18 . A computer program product comprising code, stored in a non-transitory computer-readable storage medium, the code comprising:
code to receive content, provided by an application running on a device; code to determine that the content corresponds to two-dimensional content; code to identify a portion of the two-dimensional content for enhancement by a three-dimensional render; code to enhance the portion of the two-dimensional content by the three-dimensional renderer; code to render, by a two-dimensional renderer that is separate from the three-dimensional renderer, another portion of the two-dimensional content; and code to provide for display of the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content on a display of the device.
19 . The computer program product of claim 18 , wherein the code further comprises:
code to composite a pass-through video stream with the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content.
20 . The computer program product of claim 18 , wherein the application was compiled for display of content in a two-dimensional display mode.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.