论文标题

DCS-RISR:有效现实世界图像超分辨率的动态通道分裂

DCS-RISR: Dynamic Channel Splitting for Efficient Real-world Image Super-Resolution

论文作者

Qiao, Junbo, Lin, Shaohui, Zhang, Yunlun, Li, Wei, Hu, Jie, He, Gaoqi, Wang, Changbo, Ma, Lizhuang

论文摘要

现实世界图像超分辨率(RISR)已获得了增加的重点,以提高未知复杂降解下的SR图像质量。现有的方法依靠重型SR模型来增强不同降解水平的低分辨率(LR)图像,从而大大限制了其在资源有限的设备上的实际部署。在本文中,我们提出了一种新型的动态通道分裂方案,用于有效的现实图像超分辨率,称为DCS-RISR。具体而言,我们首先引入光降解预测网络,以回归降解向量以模拟现实世界的降解,并在其上生成通道拆分向量作为有效SR模型的输入。然后,提出了一个可学习的八度卷积块,以自适应地决定每个块低频和高频功能的通道分割量表,从而通过将大型到低频功能以及小规模的高尺度来降低计算开销和内存成本。为了进一步提高RISR性能,使用非本地正则化来补充LR和HR子空间中具有自由构成推断的斑块知识。广泛的实验证明了DCS-RISR对不同基准数据集的有效性。我们的DCS-RISR不仅实现了计算/参数和PSNR/SSIM度量之间的最佳权衡,而且还可以有效地处理具有不同降解级别的真实图像。

Real-world image super-resolution (RISR) has received increased focus for improving the quality of SR images under unknown complex degradation. Existing methods rely on the heavy SR models to enhance low-resolution (LR) images of different degradation levels, which significantly restricts their practical deployments on resource-limited devices. In this paper, we propose a novel Dynamic Channel Splitting scheme for efficient Real-world Image Super-Resolution, termed DCS-RISR. Specifically, we first introduce the light degradation prediction network to regress the degradation vector to simulate the real-world degradations, upon which the channel splitting vector is generated as the input for an efficient SR model. Then, a learnable octave convolution block is proposed to adaptively decide the channel splitting scale for low- and high-frequency features at each block, reducing computation overhead and memory cost by offering the large scale to low-frequency features and the small scale to the high ones. To further improve the RISR performance, Non-local regularization is employed to supplement the knowledge of patches from LR and HR subspace with free-computation inference. Extensive experiments demonstrate the effectiveness of DCS-RISR on different benchmark datasets. Our DCS-RISR not only achieves the best trade-off between computation/parameter and PSNR/SSIM metric, and also effectively handles real-world images with different degradation levels.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源