Attention Mechanisms in CNN-Based Single Image Super-Resolution: A Brief Review and a New Perspective

Electronics

Hongyu Zhu¹  Yeqi Fei¹  Chao Xie¹  Huanjie Tao² 

[1] College of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing 210037, China;School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China;

关键词: super-resolution;    deep learning;    convolution neural networks;    attention mechanisms;   

DOI  :  10.3390/electronics10101187

来源: DOAJ

【 摘 要 】

With the advance of deep learning, the performance of single image super-resolution (SR) has been notably improved by convolution neural network (CNN)-based methods. However, the increasing depth of CNNs makes them more difficult to train, which hinders the SR networks from achieving greater success. To overcome this, a wide range of related mechanisms has been introduced into the SR networks recently, with the aim of helping them converge more quickly and perform better. This has resulted in many research papers that incorporated a variety of attention mechanisms into the above SR baseline from different perspectives. Thus, this survey focuses on this topic and provides a review of these recently published works by grouping them into three major categories: channel attention, spatial attention, and non-local attention. For each of the groups in the taxonomy, the basic concepts are first explained, and then we delve deep into the detailed insights and contributions. Finally, we conclude this review by highlighting the bottlenecks of the current SR attention mechanisms, and propose a new perspective that can be viewed as a potential way to make a breakthrough.

【 授权许可】

Unknown