Single-Image super-resolution-When model adaptation matters

PATTERN RECOGNITION

卷:116

Article

Liang, Yudong^1,2  Timofte, Radu³  Wang, Jinjun²  Zhou, Sanping²  Gong, Yihong²  Zheng, Nanning² 

[1] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan, Shanxi, Peoples R China

[2] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian, Shaanxi, Peoples R China

[3] Swiss Fed Inst Technol, Comp Vis Lab, Dept Informat Technol & Elect Engn, Zurich, Switzerland

关键词: Internal prior;    Model adaptation;    Deep convolutional neural network;    Projection skip connection;   

DOI  :  10.1016/j.patcog.2021.107931

来源: Elsevier

【 摘 要 】

In recent years, impressive advances have been made in single-image super-resolution. Deep learning is behind much of this success. Deep(er) architecture design and external prior modeling are the key ingredients. The internal contents of the low-resolution input image are neglected with deep modeling, despite earlier works that show the power of using such internal priors. In this paper, we propose a variation of deep residual convolutional neural networks, which has been carefully designed for robustness and efficiency in both learning and testing. Moreover, we propose multiple strategies for model adaptation to the internal contents of the low-resolution input image and analyze their strong points and weaknesses. By trading runtime and using internal priors, we achieve improvements from 0.1 to 0.3 dB PSNR over the reported results on standard datasets. Our adaptation especially favors images with repetitive structures or high resolutions. It indicates a more practical usage when our adaption approach applies to sequences or videos in which adjacent frames are strongly correlated in their contents. Moreover, the approach can be combined with other simple techniques, such as back-projection and enhanced prediction, to realize further improvements. (c) 2021 Published by Elsevier Ltd.

【 授权许可】

Free