Method and system for generating dynamic user interface layout for an electronic device

Abstract

The present disclosure relates to a method and a layout generation system for generating dynamic User Interface (UI) layout for an electronic device. The method includes identifying one or more operations related to at least one UI element based on a current state of a display screen of the electronic device, calculating a saliency score and an aesthetic score for each of a plurality of grids determined on the display screen, based on the calculated saliency score and the calculated aesthetic score, identifying a plurality of candidate regions, identifying an optimal region from the plurality of candidate regions based on a user interaction score and generating the dynamic UI layout by performing the one or more operations related to the at least one UI element in the optimal region.

What is claimed is: 
     
       1. A method for generating dynamic User Interface (UI) layout for an electronic device, the method comprising:
 identifying, by a layout generation system, one or more operations related to at least one UI element on a display screen of the electronic device based on a current state of the display screen of the electronic device, the display screen of the electronic device including a lock screen of the electronic device; 
 calculating, by the layout generation system, a saliency score for each of a plurality of grids on the display screen based on a saliency score machine learning model trained by using a deep learning mechanism and calculating, by the layout generation system, an aesthetic score for each of the plurality of grids on the display screen based on an aesthetic score machine learning model trained by using the deep learning mechanism; 
 identifying, by the layout generation system, a plurality of candidate regions on the display screen based on the calculated saliency score and the calculated aesthetic score; 
 identifying, by the layout generation system, an optimal region for the at least one UI element from the plurality of candidate regions on the display screen based on a user interaction score for the display screen; 
 generating, by the layout generation system, the dynamic UI layout by performing the one or more operations related to the at least one UI element in the optimal region; and 
 applying, by the layout generation system, the dynamic UI layout to the display screen of the electronic device including the lock screen of the electronic device, 
 wherein the identifying of the optimal region from the plurality of candidate regions comprises: 
 calculating a composition score based on the saliency score for each of the plurality of grids on the display screen, the aesthetic score for each of the plurality of grids on the display screen, and the user interaction score for the display screen, the composition score being a weighted average of the saliency score, the aesthetic score, and the user interaction score; and 
 identifying the optimal region based on the composition score, 
 wherein the display screen displays the at least one UI element and a background image, and the at least one UI element includes a UI element of an application on the display screen, and 
 wherein the one or more operations include re-arrangement of the at least one UI element in relation to the background image on the display screen. 
 
     
     
       2. The method as claimed in  claim 1 , wherein upon identifying the one or more operations, the display screen is divided into the plurality of grids based on parameters associated with the at least one UI element. 
     
     
       3. The method as claimed in  claim 2 , wherein the parameters associated with the at least one UI element comprise size, transparency, and interactability with users. 
     
     
       4. The method as claimed in  claim 1 , wherein the saliency score for each of the plurality of grids on the display screen and the aesthetic score for each of the plurality of grids on the display screen are calculated based on respective heatmap output of pre-trained machine learning models. 
     
     
       5. The method as claimed in  claim 1 , wherein the saliency score corresponds to prominent features in the display screen, the aesthetic score corresponds to a region with ideal placement possibilities and the user interaction score corresponds to a region comprising locations with pre-determined accessibility threshold. 
     
     
       6. The method as claimed in  claim 1 , wherein the user interaction score is determined based on pre-determined user behavior of usage of the electronic device. 
     
     
       7. The method as claimed in  claim 1 , further comprising:
 receiving at least one of an input from the electronic device and a user input to trigger the re-arrangement of the at least one UI element in the electronic device; 
 determining locations of the plurality of candidate regions and of the optimal region; 
 identifying current position of the at least one UI element in relation to the plurality of candidate regions and the optimal region; and 
 moving the at least one UI element away from the plurality of candidate regions. 
 
     
     
       8. The method as claimed in  claim 1 , further comprising:
 identifying the at least one UI element currently being displayed on the electronic device, wherein the at least one UI element and an image content are simultaneously displayed on the electronic device; and 
 displaying the at least one UI element on the identified optimal region. 
 
     
     
       9. A layout generation system for generating dynamic User Interface (UI) layout for an electronic device, comprising:
 a processor; and 
 a memory communicatively coupled to the processor and storing instructions executable by the processor, 
 wherein the processor is configured to:
 identify one or more operations related to at least one UI element on a display screen of the electronic device based on a current state of the display screen of the electronic device, the display screen of the electronic device including a lock screen of the electronic device; 
 calculate a saliency score for each of a plurality of grids on the display screen based on a saliency score machine learning model trained by using a deep learning mechanism and calculate an aesthetic score for each of the plurality of grids on the display screen based on an aesthetic score machine learning model trained by using the deep learning mechanism; 
 identify a plurality of candidate regions on the display screen based on the calculated saliency score and the calculated aesthetic score; 
 identify an optimal region for the at least one UI clement from the plurality of candidate regions on the display screen based on a user interaction score for the display screen; 
 generate the dynamic UI layout by performing the one or more operations related to the at least one UI element in the optimal region; 
 apply the dynamic UI layout to the display screen of the electronic device including the lock screen of the electronic device, 
 wherein the processor is further configured to: calculate a composition score based on the saliency score for each of the plurality of grids on the display screen, the aesthetic score for each of the plurality of grids on the display screen, and the user interaction score for the display screen, the composition score being a weighted average of the saliency score, the aesthetic score, and the user interaction score; and 
 identify the optimal region based on the composition score, 
 wherein the display screen displays the at least one UI element and a background image, and the at least one UI element includes a UI element of an application on the display screen, and 
 wherein the one or more operations include re-arrangement of the at least one UI element in relation to the background image on the display screen. 
 
 
     
     
       10. The layout generation system as claimed in  claim 9 , wherein upon identifying the one or more operations, the processor is further configured to divide the display screen into the plurality of grids based on parameters associated with the at least one UI element. 
     
     
       11. The layout generation system as claimed in  claim 10  wherein the parameters associated with the at least one UI element comprise size, transparency, and interactability with users. 
     
     
       12. The layout generation system as claimed in  claim 9 , wherein the processor is further configured to calculate the saliency score for each of the plurality of grids on the display screen and the aesthetic score for each of the plurality of grids on the display screen based on respective heatmap output of pre-trained machine learning models. 
     
     
       13. The layout generation system as claimed in  claim 9 , wherein the saliency score corresponds to prominent features in the display screen, the aesthetic score corresponds to a region with ideal placement possibilities and the interaction score corresponds to a region comprising locations with pre-determined accessibility threshold. 
     
     
       14. The layout generation system as claimed in  claim 9 , wherein the processor is further configured to determine the user interaction score based on pre-determined user behavior of usage of the electronic device. 
     
     
       15. The layout generation system as claimed in  claim 9 , wherein the processor is further configured to:
 receive at least one of an input from the electronic device and a user input to trigger the re-arrangement of the at least one UI element in the electronic device; 
 determine locations of the plurality of candidate regions and of the optimal region; 
 identify current position of the at least one UI element in relation to the plurality of candidate regions and the optimal region; and 
 move the at least one UI element away from the plurality of candidate regions. 
 
     
     
       16. The layout generation system as claimed in  claim 9 , wherein the processor is further configured to:
 identify the at least one UI element currently being displayed on the electronic device, wherein the at least one UI element and an image content are being simultaneously displayed on the electronic device; and 
 display the at least one UI element on the identified optimal region.