Method and apparatus for displaying composition screen image by composing screen images of operating systems (OSs)

Abstract

A method of composing and displaying screen images includes transmitting a screen image of a guest operating system (OS) to a host OS, in response to the guest OS and the host OS exclusively or jointly accessing a graphics processing unit (GPU) in a pass-through or mediated pass-through environment via GPU virtualization; generating a composition screen image by transforming the screen image of the guest OS into a texture and composing the texture with a texture screen image of the host OS; and displaying the composition screen image.

What is claimed is: 
     
       1. A method of composing and displaying screen images, implemented by at least one processor, the method comprising:
 transmitting a screen image of a guest operating system (OS) to a host OS, in response to the guest OS and the host OS exclusively or jointly accessing a graphics processing unit (GPU) in a mediated pass-through environment via GPU virtualization; 
 adjusting a scheduling priority of the GPU for the guest OS and the host OS based on a comparison between a target frames per second (FPS) and a current FPS of the guest OS and the host OS; 
 generating a composition screen image by copying the screen image stored in a first storage area of the guest OS to a second storage area of the host OS in response to receiving a storage completion signal for the screen image of the guest OS from the guest OS and transforming the screen image of the guest OS into a texture and composing the texture with a texture screen image of the host OS; and 
 displaying the composition screen image, 
 wherein the generating the composition screen image comprises, in response to a format of the screen image of the guest OS being different from a format of the texture screen image of the host OS, transforming the format of the screen image of the guest OS into a format of the host OS to generate the texture. 
 
     
     
       2. The method of  claim 1 , wherein the transmitting the screen image of the guest OS comprises:
 checking an address of a guest frame buffer in which the screen image of the guest OS is stored; and 
 transmitting the address of the guest frame buffer to the host OS. 
 
     
     
       3. The method of  claim 2 , wherein:
 the transmitting the screen image of the guest OS comprises directly transmitting the address of the guest frame buffer to the host OS or transmitting the address of the guest frame buffer to the host OS via a hypervisor; and 
 the transmitting is performed by the guest OS. 
 
     
     
       4. The method of  claim 3 , wherein:
 the transmitting the screen image of the guest OS comprises transmitting the address of the guest frame buffer to the host OS after receiving a signal from the guest OS, or transmitting the address of the guest frame buffer to the host OS in response to detecting that the guest OS has accessed the guest frame buffer, or transmitting the address of the guest frame buffer to the host OS at regular intervals of a preset time period; and 
 the transmitting is performed by the hypervisor. 
 
     
     
       5. The method of  claim 1 , wherein the generating the composition screen image comprises transforming the screen image of the guest OS into the texture by the host OS, or transforming the screen image of the guest OS into the texture by the GPU. 
     
     
       6. The method of  claim 1 , wherein the displaying the composition screen image comprises displaying the screen image of the guest OS and the screen image of the host OS in a plurality of windows. 
     
     
       7. The method of  claim 1 , wherein the displaying the composition screen image comprises displaying the screen image of the guest OS or the screen image of the host OS in a sub-window. 
     
     
       8. The method of  claim 1 , wherein the displaying the composition screen image comprises displaying the screen image of the host OS together with a notification bar. 
     
     
       9. An electronic apparatus comprising:
 at least one processor configured to control:
 a guest OS configured to transmit a screen image of the guest OS to a host OS, in response to the guest OS and the host OS exclusively or jointly accessing a graphics processing unit (GPU) in a mediated- pass-through environment via GPU virtualization, and 
 the host OS configured to generate a composition screen image by copying the screen image stored in a first storage area of the guest OS to a second storage area of the host OS in response to receiving a storage completion signal for the screen image of the guest OS from the guest OS and transforming the screen image of the guest OS into a texture and composing the texture with a texture screen image of the host OS; and 
 a hypervisor configured to adjust a scheduling priority of the GPU for the guest OS and the host OS based on a comparison between a target frames per second (FPS) and a current FPS of the guest OS and the host OS; 
 
 a display configured to display the composition screen image, 
 wherein, in response to a format of the screen image of the guest OS being different from a format of the texture screen image of the host OS, the host OS generates the texture by transforming the format of the screen image of the guest OS into a format of the host OS. 
 
     
     
       10. The electronic apparatus of  claim 9 , wherein the guest OS checks an address of a guest frame buffer in which the screen image of the guest OS is stored, and transmits the address of the guest frame buffer to the host OS. 
     
     
       11. The electronic apparatus of  claim 10 , wherein the hypervisor is configured to transmit the address of the guest frame buffer to the host OS. 
     
     
       12. The electronic apparatus of  claim 11 , wherein the hypervisor transmits the address of the guest frame buffer to the host OS after the hypervisor receives a signal from the guest OS, or transmits the address of the guest frame buffer to the host OS in response to detecting that the guest OS has accessed the guest frame buffer, or transmits the address of the guest frame buffer to the host OS at regular intervals of a preset time period. 
     
     
       13. The electronic apparatus of  claim 9 , wherein the host OS transforms the screen image of the guest OS into the texture, or the GPU transforms the screen image of the guest OS into the texture. 
     
     
       14. The electronic apparatus of  claim 9 , wherein the host OS controls the display to display the screen image of the guest OS and the screen image of the host OS in a plurality of windows. 
     
     
       15. The electronic apparatus of  claim 9 , wherein the host OS controls the display to display the screen image of the guest OS or the screen image of the host OS in a sub-window. 
     
     
       16. The electronic apparatus of  claim 9 , wherein the host OS controls the display to display the screen image of the host OS together with a notification bar. 
     
     
       17. A non-transitory computer-readable recording medium having recorded thereon a computer program, which, when executed by a computer, performs the method of  claim 1 . 
     
     
       18. A method of composing and displaying screen images, implemented by at least one processor, the method comprising:
 transmitting a screen image of a guest operating system (OS) to a host OS, in response to the guest OS and the host OS jointly accessing a graphics processing unit (GPU); 
 adjusting a scheduling priority of the GPU for the guest OS and the host OS based on a comparison between a target frames per second (FPS) and a current FPS of the guest OS and the host OS; 
 generating a composition screen image by copying the screen image stored in a first storage area of the guest OS to a second storage area of the host OS in response to the host OS receiving a storage completion signal for the screen image of the guest OS from the guest OS and transforming the screen image of the guest OS into a texture and composing the texture with a texture screen image of the host OS; and displaying the composition screen image, 
 wherein the generating the composition screen image comprises, in response to a format of the screen image of the guest OS being different from a format of the texture screen image of the host OS, transforming the format of the screen image of the guest OS into a format of the host OS to generate the texture.