Developing an Image Manipulation Detection Algorithm Based on Edge Detection and Faster R-CNN

Symmetry

Xiaoyan Wei¹  Yirong Wu¹  Shuifa Sun¹  Fangmin Dong¹  Jun Zhang² 

[1] College of Computer and Information Technology, China Three Gorges University, Yichang 443002, China;Department of Electrical Engineering and Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI 53201, USA;

关键词: image manipulation detection;    faster r-cnn;    edge detection;    max pooling;   

DOI  :  10.3390/sym11101223

来源: DOAJ

【 摘 要 】

Due to the wide availability of the tools used to produce manipulated images, a large number of digital images have been tampered with in various media, such as newspapers and social networks, which makes the detection of tampered images particularly important. Therefore, an image manipulation detection algorithm leveraged by the Faster Region-based Convolutional Neural Network (Faster R-CNN) model combined with edge detection was proposed in this paper. In our algorithm, first, original tampered images and their detected edges were sent into symmetrical ResNet101 networks to extract tampering features. Then, these features were put into the Region of Interest (RoI) pooling layer. Instead of the RoI max pooling approach, the bilinear interpolation method was adopted to obtain the RoI region. After the RoI features of original input images and edge feature images were sent into bilinear pooling layer for feature fusion, tampering classification was performed in fully connection layer. Finally, Region Proposal Network (RPN) was used to locate forgery regions. Experimental results on three different image manipulation datasets show that our proposed algorithm can detect tampered images more effectively than other existing image manipulation detection algorithms.

【 授权许可】

Unknown