Visual Attention Fusion Framework for Image Retargeting Quality Assessment

6th Annual 2018 International Conference on Geo-Spatial Knowledge and Intelligence

Zhang, Shuai^1 ; Niu, Yuzhen^1 ; Lin, Jiawen^1 ; Chen, Junhao^1

College of Mathematics and Computer Science, Fuzhou University, Fuzhou, China^1

关键词: Human visual attention;    Image retargeting;    Image saliencies;    Quality assessment;    Salient object detection;    Sensitive regions;    State of the art;    Subjective perceptions;   

Others  :  https://iopscience.iop.org/article/10.1088/1755-1315/234/1/012064/pdf
DOI  :  10.1088/1755-1315/234/1/012064

来源: IOP

【 摘 要 】

To adapt images for diversified digital devices, researchers have presented many image retargeting methods. However, the consistency between results of objective image retargeting quality assessment (IRQA) metrics and subjective perception is still low. In this paper, we propose a visual attention fusion (VAF) framework to assist IRQA metrics in better understanding the features of images such as image saliency, faces, and lines. First, we combine the results of multiple salient object detection algorithms to reduce the limitations of a single algorithm. Second, faces and lines are considered in our framework to measure deformations to these visually sensitive regions. Finally, we propose a saliency enhancement model to simulate human visual attention for IRQA. We combine the proposed VAF framework with some state-of-the-art IRQA metrics. Experimental results show that the proposed VAF framework can improve the consistency between the results of objective IRQA metrics and subjective opinion scores.