US2022092847A1PendingUtilityA1

Managing multi-modal rendering of application content

54
Assignee: APPLE INCPriority: Sep 3, 2019Filed: Dec 1, 2021Published: Mar 24, 2022
Est. expirySep 3, 2039(~13.1 yrs left)· nominal 20-yr term from priority
H04N 13/261G06F 3/011G06T 11/60G06T 19/006H04N 13/293G06T 17/005G06T 2200/24G06T 15/205G06T 5/002G06T 5/006G06T 5/70G06T 5/80
54
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for display. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A method, comprising:
 receiving content, provided by an application running on a device;   determining that the content corresponds to two-dimensional content;   identifying a portion of the two-dimensional content for enhancement by a three-dimensional render;   enhancing, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer;   compositing a pass-through video stream with at least the rendered enhanced portion of the two-dimensional content; and   providing for display of the rendered enhanced portion of the two-dimensional content composited with the pass-through video stream on a display of the device.   
     
     
         2 . The method of  claim 1 , wherein enhancing the identified portion of the two-dimensional content further comprises rendering the enhanced identified portion of the two-dimensional content and the method further comprising:
 rendering, by a two-dimensional renderer that is separate from the three-dimensional renderer, another portion of the two-dimensional content; and   providing for display of the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content on the display of the device.   
     
     
         3 . The method of  claim 1 , wherein the application was compiled for display of content in a two-dimensional display mode. 
     
     
         4 . The method of  claim 1 , wherein the content is declaratively defined. 
     
     
         5 . The method of  claim 4 , wherein the content is declaratively defined based at least in part on a layer tree and identifying the portion of the two-dimensional content for enhancement by the three-dimensional render further comprises:
 determining that a layer of the layer tree comprises a particular flag that identifies the layer for enhancement.   
     
     
         6 . The method of  claim 1 , wherein the content for enhancement comprises a particular visual effect associated with one or more attributes, and enhancing, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer comprises rendering a three-dimensional version of the particular visual effect based on the one or more attributes. 
     
     
         7 . The method of  claim 6 , wherein the particular visual effect comprises a blur effect, and the one or more attributes comprise at least one of a size or a depth of the blur effect. 
     
     
         8 . The method of  claim 1 , wherein the identified portion of the two-dimensional content for enhancement comprises text content, and the method further comprises:
 serializing the text content into a format for processing by a graphics processing unit;   passing the serialized text content to the graphics processing unit; and   receiving, from the graphics processing unit, a vector graphics based version of the text content.   
     
     
         9 . The method of  claim 8 , wherein providing for display of the rendered enhanced portion of the two-dimensional content on the display of the device comprises:
 providing for display of the vector graphics based version of the text content in a manner that is perspective correct with respect to a user of the device.   
     
     
         10 . The method of  claim 1 , wherein enhancing the two-dimensional content comprises transforming a predefined two-dimensional user interface element included in the two-dimensional content to a corresponding three-dimensional user interface element. 
     
     
         11 . The method of  claim 1 , wherein enhancing the two-dimensional content comprises performing at least one of compositing or lens correction with respect to the two-dimensional content, based on specifications of the display. 
     
     
         12 . The method of  claim 1 , wherein enhancing the portion of the two-dimensional content comprises converting the portion of the two-dimensional content from a monoscopic video format to a stereoscopic video format. 
     
     
         13 . A device, comprising:
 at least one processor; and   a memory including instructions that, when executed by the at least one processor, cause the at least one processor to:
 receive content, provided by an application running on a device; 
 determine that the content corresponds to two-dimensional content; 
 identify a portion of the two-dimensional content for enhancement by a three-dimensional render; 
 enhance the portion of the two-dimensional content by the three-dimensional renderer; 
 render, by a two-dimensional renderer that is separate from the three-dimensional renderer, another portion of the two-dimensional content; and 
 provide for display of the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content on a display of the device. 
   
     
     
         14 . The device of  claim 13 , wherein the at least one processor is further configured to:
 composite a pass-through video stream with the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content.   
     
     
         15 . The device of  claim 13 , wherein the application was compiled for display of content in a two-dimensional display mode. 
     
     
         16 . The device of  claim 13 , wherein the content is declaratively defined. 
     
     
         17 . The device of  claim 16 , wherein the content is declaratively defined based at least in part on a layer tree and identifying the portion of the two-dimensional content for enhancement by the three-dimensional render further comprises:
 determining that a layer of the layer tree comprises a particular flag that identifies the layer for enhancement.   
     
     
         18 . A computer program product comprising code, stored in a non-transitory computer-readable storage medium, the code comprising:
 code to receive content, provided by an application running on a device;   code to determine that the content corresponds to two-dimensional content;   code to identify a portion of the two-dimensional content for enhancement by a three-dimensional render;   code to enhance the portion of the two-dimensional content by the three-dimensional renderer;   code to render, by a two-dimensional renderer that is separate from the three-dimensional renderer, another portion of the two-dimensional content; and   code to provide for display of the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content on a display of the device.   
     
     
         19 . The computer program product of  claim 18 , wherein the code further comprises:
 code to composite a pass-through video stream with the rendered enhanced portion of the two-dimensional content and the rendered other portion of the two-dimensional content.   
     
     
         20 . The computer program product of  claim 18 , wherein the application was compiled for display of content in a two-dimensional display mode.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.