Method and system for image scaling and enhancement

Abstract

A system for image scaling and enhancement is provided. The system includes a scaling processing unit, a deep-learning residue network unit and a combination unit. The filter scaling processing unit is configured to upscale a low-resolution image to output a high-resolution image. The deep-learning residue network unit is operated based on a deep-learning result, and configured to output a high-resolution residue image corresponding to the low-resolution image. The combination unit is configured to adjust the high-resolution residue image according to a weighting factor and combine an adjusted high-resolution residue image and the high-resolution image, in order to output an enhanced image, wherein the weighting factor is different from a reference weighting factor being used in a deep-learning procedure for training the deep-learning residue network unit.

What is claimed is: 
     
       1. An image scaling and enhancement system, comprising:
 a scaling processing unit, configured to upscale a low-resolution image to output a high-resolution image; 
 a deep-learning residue network unit, operated based on a deep-learning result, configured to output a high-resolution residue image corresponding to the low-resolution image; and 
 a combination processing unit, coupled to the scaling processing unit and the deep-learning residue network unit, configured to adjust the high-resolution residue image according to a weighting factor and combine an adjusted high-resolution residue image and the high-resolution image in order to generate an enhanced image, wherein the weighting factor is different from a reference weighting factor being used in a deep-learning procedure for training the deep-learning residue network unit; 
 wherein the image scaling and enhancement system determines the weighting factor according to at least one of high-frequency characteristics, boundary strength and color characteristics of pixels around a specific pixel of one of the low-resolution image and the high-resolution image. 
 
     
     
       2. The system of  claim 1 , wherein the weighting factor is an user-defined fixed value or a value determined based on content characteristics of the low-resolution image. 
     
     
       3. The system of  claim 1 , further comprising:
 a weighting factor determination unit, coupled to the combination processing unit, configured to determine the weighting factor. 
 
     
     
       4. The system of  claim 3 , wherein the weighting factor determination unit is configured to determine the weighting factor for each pixel according to the low-resolution image. 
     
     
       5. The system of  claim 3 , wherein the weighting factor determination unit is configured to determine the weighting factor for each pixel according to the high-resolution image. 
     
     
       6. The system of  claim 1 , wherein the deep-learning residue network unit comprises an arbitrary number of layers or structures. 
     
     
       7. An image scaling and enhancement method, comprising:
 upscaling a low-resolution image to output a high-resolution image; 
 based on a deep-learning result, outputting a high-resolution residue image corresponding to the low-resolution image; 
 determining a weighting factor according to at least one of high-frequency characteristics, boundary strength and color characteristics of pixels around a specific pixel of one of the low-resolution image and the high-resolution image; and 
 adjusting the high-resolution residue image according to the weighting factor and combining an adjusted high-resolution residue image and the high-resolution image in order to generate an enhanced image, wherein the weighting factor is different from a reference weighting factor being used in obtaining the deep-learning result. 
 
     
     
       8. The method of  claim 7 , wherein the weighting factor is an user-defined fixed value or a value determined based on content characteristics of the low-resolution image. 
     
     
       9. The method of  claim 7 , further comprising:
 determining the weighting factor for each pixel according to one of the low-resolution image and the high-resolution image.