A dual-weighted polarization image fusion method based on quality assessment and attention mechanisms

Frontiers in Physics

Physics

Cai Cheng¹  Meiling Gao¹  Guangqiu Chen¹  Hao Zhang¹  Ju Liu¹  Jin Duan² 

[1] College of Electronic Information Engineering, Changchun, China;null;

关键词: image fusion;    polarization image;    double weighting;    quality assessment;    attention mechanisms;   

DOI  :  10.3389/fphy.2023.1214206

 received in 2023-04-29, accepted in 2023-06-14,  发布年份 2023

来源: Frontiers

【 摘 要 】

This paper proposes a dual-weighted polarization image fusion method based on quality assessment and attention mechanisms to fuse the intensity image (S0) and the degree of linear polarization (DoLP). S0 has high contrast and clear details, and DoLP has an outstanding ability to characterize polarization properties, so the fusion can achieve an effective complementation of superior information. We decompose S0 and DoLP into base layers and detail layers. In the base layers, we build a quality assessment unit combining information entropy, no-reference image quality assessment, and local energy to ensure the fused image has high contrast and clear and natural visual perception; in the detail layer, we first extract depth features using the pre-trained VGG19, then construct an attention enhancement unit combining space and channels, and finally effectively improve the preservation of detail information and edge contours in the fused image. The proposed method is able to perceive and retain polarization image features sufficiently to obtain desirable fusion results. Comparing nine typical fusion methods on two publicly available and own polarization datasets, experimental results show that the proposed method outperforms other comparative algorithms in both qualitative comparison and quantitative analysis.

【 授权许可】

Unknown   
Copyright © 2023 Duan, Zhang, Liu, Gao, Cheng and Chen.