Systems and methods for recognizability of objects in a multi-layer display

Abstract

A method, system, and computer-readable media of generating a display on a device, including combining content from a plurality of sources into a display, the content from each of the plurality of sources being presented as a layer of the display, and further, each layer of the display being of substantially the same dimensions, detecting one or more objects in each layer of the generated display, and for one or more of the detected objects determining an object type or classification, determining if the object is overlapping or obscuring an object in a different layer of the generated display, and determining if the object will appear to a viewer as if it will overlap or obscure an object in a different layer of the generated display as a result of the motion, orientation, or gaze of the viewer.

What is claimed is: 
     
         1 . A method, comprising:
 detecting an object in a layer of a display;   determining an object type or classification of the object;   determining whether the object is overlapping or obscuring a different object in a different layer of the display; and   based on the object type or classification or a determination that the object is overlapping or obscuring a different object in a different layer of the display, modifying a transparency, a shape, a color, a contrast, an opacity, or a resolution of the object based on a rule or trained model.   
     
     
         2 . The method of  claim 1 , wherein modifying based on a rule or trained model comprises modifying the transparency, the shape, the color, or the opacity. 
     
     
         3 . The method of  claim 1 , wherein modifying based on a rule or trained model comprises modifying the transparency. 
     
     
         4 . The method of  claim 1 , wherein the layer and the different layer are of substantially the same dimensions and associated with different sources. 
     
     
         5 . The method of  claim 4 , wherein the sources comprise one or more of a video camera, an application executing on a user’s device, or a remote server storing content. 
     
     
         6 . The method of  claim 1 , further comprising determining whether the object should be made selectable or not selectable, and in response setting the transparency, the shape, the color, the contrast, the opacity, or the resolution accordingly. 
     
     
         7 . The method of  claim 1 , wherein modifying based on a rule or trained model further comprises accessing a rule, a set of rules, or a trained model from a user’s device that determines how to process the object. 
     
     
         8 . The method of  claim 1 , wherein when the object is determined to be text expressed in a first language, then the method further comprises:
 translating the text into a second language;   removing the text in the first language; and   inserting the text in the second language into the display.   
     
     
         9 . A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by a computer, cause the computer to perform a method, the method comprising:
 detecting an object in a layer of a display;   determining an object type or classification of the object;   determining whether the object is overlapping or obscuring a different object in a different layer of the display; and   based on the object type or classification or a determination that the object is overlapping or obscuring a different object in a different layer of the display, modifying a transparency, a shape, a color, a contrast, an opacity, or a resolution of the object based on a rule or trained model.   
     
     
         10 . The non-transitory computer-readable storage medium of  claim 9 , wherein modifying based on a rule or trained model comprises modifying the transparency, the shape, the color, or the opacity. 
     
     
         11 . The non-transitory computer-readable storage medium of  claim 9 , wherein modifying based on a rule or trained model comprises modifying the transparency. 
     
     
         12 . The non-transitory computer-readable storage medium of  claim 9 , wherein the layer and the different layer are of substantially the same dimensions and associated with different sources. 
     
     
         13 . The non-transitory computer-readable storage medium of  claim 12 , wherein the sources comprise one or more of a video camera, an application executing on a user’s device, or a remote server storing content. 
     
     
         14 . The non-transitory computer-readable storage medium of  claim 9 , further comprising determining whether the object should be made selectable or not selectable, and in response setting the transparency, the shape, the color, the contrast, the opacity, or the resolution accordingly. 
     
     
         15 . The non-transitory computer-readable storage medium of  claim 9 , wherein modifying based on a rule or trained model further comprises accessing a rule, a set of rules, or a trained model from a user’s device that determines how to process the object. 
     
     
         16 . The non-transitory computer-readable storage medium of  claim 9 , wherein when the object is determined to be text expressed in a first language, then the method further comprises:
 translating the text into a second language;   removing the text in the first language; and   inserting the text in the second language into the display.   
     
     
         17 . An apparatus, comprising:
 processing circuitry configured to:
 detect an object in a layer of a display, 
 determine an object type or classification of the object, 
 determine whether the object is overlapping or obscuring a different object in a different layer of the display, and 
 based on the object type or classification or a determination that the object is overlapping or obscuring a different object in a different layer of the display, modify a transparency, a shape, a color, a contrast, an opacity, or a resolution of the object based on a rule or trained model. 
   
     
     
         18 . The apparatus of  claim 17 , wherein the processing circuitry is configured to modify based on a rule or trained model by modifying the transparency, the shape, the color, or the opacity. 
     
     
         19 . The apparatus of  claim 17 , wherein the processing circuitry is configured to modify based on a rule or trained model by modifying the transparency. 
     
     
         20 . The apparatus of  claim 17 , wherein the layer and the different layer are of substantially the same dimensions and associated with different sources.