A Novel Image Fusion Framework Based on Sparse Representation and Pulse Coupled Neural Network

IEEE Access

Li Yin¹  Zhiqin Zhu²  Guanqiu Qi³  Jaesung Sim⁴  Mingyao Zheng⁵  Fu Jin⁵ 

[1] Chongqing Key Laboratory of Translational Research for Cancer Metastasis and Individualized Treatment, Chongqing University Cancer Hospital and Chongqing Cancer Institute, Chongqing Cancer Hospital, Chongqing, China;College of Automation, Chongqing University of Posts and Telecommunications, Chongqing, China;Computer Information Systems Department, Buffalo State College, Buffalo, NY, USA;Department of Mathematics and Computer Information Science, Mansfield University of Pennsylvania, Mansfield, PA, USA;Key Laboratory for Biorheological Science and Technology of Ministry of Education (Chongqing University), Chongqing University Cancer Hospital and Chongqing Cancer Institute, Chongqing Cancer Hospital, Chongqing, China;

关键词: Multi-sensor fusion;    NSST;    PCNN;    sparse representation;    dictionary learning;    image fusion;   

DOI  :  10.1109/ACCESS.2019.2929303

来源: DOAJ

【 摘 要 】

Image fusion techniques are applied to the synthesis of two or more images captured in the same scene to obtain a high-quality image. However, most of the existing fusion algorithms are aimed at single-mode images. To improve the fusion quality of multi-modal images, a novel multi-sensor image fusion framework based on non-subsampled shearlet transform (NSST) is proposed. First, the proposed solution uses NSST to decompose source images into high- and low-frequency components. Then, an improved pulse coupled neural network (PCNN) is proposed to process high-frequency components. Thus, the feature extraction effect of the high-frequency component is meliorated. After that, a sparse representation (SR) based measure, including compact dictionary learning and Max-L1 fusion rule, is designed to enhance the detailed features of the low-frequency component. Finally, the final image is obtained by the reconstruction of high- and low-frequency components via NSST inverse transformation. The proposed method is compared with several existing fusion methods. The experiment results show that the proposed algorithm outperforms other algorithms in both subjective and objective evaluation.

【 授权许可】

Unknown