Adversarial Networks for Scale Feature-Attention Spectral Image Reconstruction from a Single RGB

Sensors

Pengfei Liu¹  Huaici Zhao¹ 

[1] Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China;

关键词: hyperspectral imaging;    generative adversarial network;    attention mechanism;    feature pyramid;    boundary supervision;   

DOI  :  10.3390/s20082426

来源: DOAJ

【 摘 要 】

Hyperspectral images reconstruction focuses on recovering the spectral information from a single RGBimage. In this paper, we propose two advanced Generative Adversarial Networks (GAN) for the heavily underconstrained inverse problem. We first propose scale attention pyramid UNet (SAPUNet), which uses U-Net with dilated convolution to extract features. We establish the feature pyramid inside the network and use the attention mechanism for feature selection. The superior performance of this model is due to the modern architecture and capturing of spatial semantics. To provide a more accurate solution, we propose another distinct architecture, named W-Net, that builds one more branch compared to U-Net to conduct boundary supervision. SAPUNet and scale attention pyramid WNet (SAPWNet) provide improvements on the Interdisciplinary Computational Vision Lab at Ben Gurion University (ICVL) datasetby 42% and 46.6%, and 45% and 50% in terms of root mean square error (RMSE) and relative RMSE,respectively. The experimental results demonstrate that our proposed models are more accurate than the state-of-the-art hyperspectral recovery methods

【 授权许可】

Unknown