Explicit-implicit dual stream network for image quality assessment

EURASIP Journal on Image and Video Processing

Tian Huang¹  Xingyu Ding¹  Guangyi Yang¹  Kun Cheng¹  Weizheng Jin² 

[1] School of Electronic Information, Wuhan University, 430072, Wuhan, China;School of Electronic Information, Wuhan University, 430072, Wuhan, China;Collaborative Innovation Center of Geospatial Technology, Wuhan University, 430079, Wuhan, China;

关键词: CNN;    Feature fusion;    IQA;    Wavelet feature extraction;    EI dual stream network;   

DOI  :  10.1186/s13640-020-00538-y

来源: Springer

【 摘 要 】

Communications industry has remarkably changed with the development of fifth-generation cellular networks. Image, as an indispensable component of communication, has attracted wide attention. Thus, finding a suitable approach to assess image quality is important. Therefore, we propose a deep learning model for image quality assessment (IQA) based on explicit-implicit dual stream network. We use frequency domain features of kurtosis based on wavelet transform to represent explicit features and spatial features extracted by convolutional neural network (CNN) to represent implicit features. Thus, we constructed an explicit-implicit (EI) parallel deep learning model, namely, EI-IQA model. The EI-IQA model is based on the VGGNet that extracts the spatial domain features. On this basis, the number of network layers of VGGNet is reduced by adding the parallel wavelet kurtosis value frequency domain features. Thus, the training parameters and the sample requirements decline. We verified, by cross-validation of different databases, that the wavelet kurtosis feature fusion method based on deep learning has a more complete feature extraction effect and a better generalisation ability. Thus, the method can simulate the human visual perception system better, and subjective feelings become closer to the human eye. The source code about the proposed EI-IQA model is available on github https://github.com/jacob6/EI-IQA.

【 授权许可】

CC BY