Image processing method, image display method and image display system

Abstract

An image processing method includes determining a display mode; processing, according to an image processing manner corresponding to the display mode, original image data to obtain target image data; and transmitting the target image data to an image display terminal, so that the image display terminal performs image display according to a scanning display manner corresponding to the display mode, a resolution of the target image data is less than or equal to that of the original image data, and the target image data carries indication information of the display mode.

What we claim is: 
     
       1. An image processing method, comprising:
 determining a display mode, wherein a display mode matched with a type of a running application is determined according to the type of the application, or a display mode selected by a user operation is determined in response to the user operation; 
 processing, according to an image processing manner corresponding to the display mode, original image data to obtain target image data, wherein a resolution of the target image data is less than or equal to that of the original image data, and the target image data carries indication information of the display mode, the indication information is added to a data header of the target image data; and 
 transmitting the target image data to an image display terminal for the image display terminal to parse the indication information of the display mode from the data header of the target image data, and to determine the display mode according to the indication information, thus to allow the image display terminal to perform image display according to a scanning display manner corresponding to the display mode, 
 wherein the display mode is one of the following modes: a normal display mode, a two-dimensional display mode, a three-dimensional display mode, and a stereoscopic light field display mode, 
 wherein allowing the image display terminal to perform image display according to a scanning display manner corresponding to the display mode comprises: 
 in a case that the display mode is a normal display mode, displaying an image to be displayed on the display according to a relationship between a resolution of the display at the image display terminal and a resolution of the image to be displayed corresponding to the target image data; 
 in a case that the display mode is a two-dimensional display mode, displaying a gaze image in the image to be displayed in a gaze area of the display and displaying a non-gaze image in the image to be displayed in a non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; 
 in a case that the display mode is a three-dimensional display mode, displaying gaze images corresponding to a left eye image and a right eye image in a fusion manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; and 
 in a case that the display mode is a stereoscopic light field display mode, displaying gaze images corresponding to a plurality of unit images in the fusion manner or a time-division multiplexing manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data. 
 
     
     
       2. The image processing method according to  claim 1 , wherein, in the normal display mode, there is no need to perform Multi-Resolution Rendering (MRS) on the original image data, and in the two-dimensional display mode, the original image data is processed in the MRS manner. 
     
     
       3. The image processing method according to  claim 2 , wherein before processing the original image data, the method further comprises: starting a single-person mode or a multi-person mode according to a quantity of persons who are watching at the same time at the image display terminal and eye gaze parameters of each person; and
 processing, according to the image processing manner corresponding to the display mode, the original image data to obtain the target image data comprises: processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data. 
 
     
     
       4. The image processing method according to  claim 3 , wherein starting the single-person mode or the multi-person mode according to the quantity of persons who are watching at the same time at the image display terminal and eye gaze parameters of each person comprises:
 in a case that the quantity of persons who are watching at the same time at the image display terminal is one, or the quantity of persons who are watching at the same time at the image display terminal is more than one and the eye gaze parameters of the plurality of persons indicate a same gaze area, starting the single-person mode; and 
 in a case that the quantity of persons who are watching at the same time at the image display terminal is more than one and the eye gaze parameters of the plurality of persons indicate at least two gaze areas, starting the multi-person mode. 
 
     
     
       5. The image processing method according to  claim 3 , wherein the display mode is a normal display mode, and the resolution of the target image data obtained according to the image processing manner in the single-person mode or the multi-person mode corresponding to the normal display mode is the same as that of the original image data. 
     
     
       6. The image processing method according to  claim 3 , wherein the display mode is a two-dimensional display mode; and
 processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data comprises: 
 dividing an original image corresponding to the original image data into at least one gaze area and a plurality of non-gaze areas according to the eye gaze parameters collected at the image display terminal, sampling the at least one gaze area using an original resolution to obtain at least one gaze image, and sampling the plurality of non-gaze areas using a compressed resolution to obtain a plurality of corresponding non-gaze images; and 
 splicing the at least one gaze image and the plurality of non-gaze images to obtain the target image data. 
 
     
     
       7. The image processing method according to  claim 6 , wherein processing the original image data according to the image processing manner in the multi-person mode corresponding to the display mode to obtain the target image data further comprises:
 segmenting the at least one gaze image to form a plurality of rectangular gaze sub-images; and 
 rearranging the plurality of gaze sub-images and the plurality of non-gaze images to subsequently obtain the target image data. 
 
     
     
       8. The image processing method according to  claim 3 , wherein the display mode is a three-dimensional display mode, and the original image data comprises a left eye image and a right eye image; and
 processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data comprises: 
 dividing, according to the eye gaze parameters collected at the image display terminal, the left eye image into at least one first gaze area and a plurality of first non-gaze areas, dividing the right eye image into at least one second gaze area and a plurality of second non-gaze areas, sampling the at least one first gaze area and the at least one second gaze area using an original resolution to obtain at least one first gaze image and at least one second gaze image, and sampling the plurality of first non-gaze areas and the plurality of second non-gaze areas using a compressed resolution to obtain a plurality of first non-gaze images and a plurality of second non-gaze images; and 
 splicing the at least one first gaze image, the at least one second gaze image, the plurality of first non-gaze images and the plurality of second non-gaze images to obtain the target image data. 
 
     
     
       9. The image processing method according to  claim 3 , wherein the display mode is a stereoscopic light field display mode, and the original image data comprises a plurality of unit images; and
 processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data comprises: 
 for any unit image, dividing the unit image into at least one gaze area and a plurality of non-gaze areas according to the eye gaze parameters collected at the image display terminal, sampling the at least one gaze area using an original resolution to obtain at least one gaze image, and sampling the plurality of non-gaze areas using a compressed resolution to obtain a plurality of non-gaze images; and 
 splicing a plurality of gaze images and the plurality of non-gaze images obtained according to the plurality of unit images to obtain the target image data, wherein the target image data comprises a plurality of frames of image data. 
 
     
     
       10. A terminal device, comprising: a memory and a processor, wherein the memory stores a computer program which, when executed by the processor, implements the image processing method according to  claim 1 . 
     
     
       11. A non-transitory computer readable storage medium, storing a computer program which, when executed by a processor, implements the image processing method according to  claim 1 . 
     
     
       12. An image display method, comprising:
 receiving target image data, wherein the target image data carries indication information of a display mode, the indication information is added to a data header of the target image data; 
 parsing the indication information of the display mode from the data header of the target image data, and determining the display mode according to the indication information; and 
 performing image display on a display at an image display terminal according to a scanning display manner corresponding to the display mode, 
 wherein the display mode is one of the following modes: a normal display mode, a two-dimensional display mode, a three-dimensional display mode, and a stereoscopic light field display mode, 
 wherein performing image display on a display at an image display terminal according to a scanning display manner corresponding to the display mode comprises: 
 in a case that the display mode is a normal display mode, displaying an image to be displayed on the display according to a relationship between a resolution of the display at the image display terminal and a resolution of the image to be displayed corresponding to the target image data; 
 in a case that the display mode is a two-dimensional display mode, displaying a gaze image in the image to be displayed in a gaze area of the display and displaying a non-gaze image in the image to be displayed in a non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; 
 in a case that the display mode is a three-dimensional display mode, displaying gaze images corresponding to a left eye image and a right eye image in a fusion manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; and 
 in a case that the display mode is a stereoscopic light field display mode, displaying gaze images corresponding to a plurality of unit images in the fusion manner or a time-division multiplexing manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data. 
 
     
     
       13. A terminal device, comprising: a display, a memory, and a processor, wherein the display is connected with the processor and is configured to provide a display interface, and the memory stores a computer program which, when executed by the processor, implements the image display method according to  claim 12 . 
     
     
       14. A non-transitory computer readable storage medium, storing a computer program which, when executed by a processor, implements the image display method according to  claim 12 . 
     
     
       15. An image display system, comprising: an image processing terminal and an image display terminal, wherein
 the image processing terminal is configured to determine a display mode, process original image data according to an image processing manner corresponding to the display mode to obtain target image data, and transmit the target image data to the image display terminal, wherein a resolution of the target image data is less than or equal to that of the original image data, and the target image data carries indication information of the display mode, the indication information is added to a data header of the target image data; and 
 the image display terminal is configured to receive the target image data, determine the display mode according to the indication information, by parsing the indication information of the display mode from the data header of the target image data, and perform image display on a display at the image display terminal according to a scanning display manner corresponding to the display mode, 
 wherein the display mode is one of the following modes: a normal display mode, a two-dimensional display mode, a three-dimensional display mode, and a stereoscopic light field display mode, 
 wherein performing image display on a display at an image display terminal according to a scanning display manner corresponding to the display mode comprises: 
 in a case that the display mode is a normal display mode, displaying an image to be displayed on the display according to a relationship between a resolution of the display at the image display terminal and a resolution of the image to be displayed corresponding to the target image data; 
 in a case that the display mode is a two-dimensional display mode, displaying a gaze image in the image to be displayed in a gaze area of the display and displaying a non-gaze image in the image to be displayed in a non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; 
 in a case that the display mode is a three-dimensional display mode, displaying gaze images corresponding to a left eye image and a right eye image in a fusion manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; and 
 in a case that the display mode is a stereoscopic light field display mode, displaying gaze images corresponding to a plurality of unit images in the fusion manner or a time-division multiplexing manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data. 
 
     
     
       16. The image display system according to  claim 15 , wherein the image processing terminal is configured to determine the display mode in one of the following manners:
 determining, according to a type of a running application, the display mode matched with the type of the application; and 
 determining, in response to a user operation, the display mode selected by the user operation.