Exposing deepfakes using a deep multilayer perceptron – convolutional neural network model

International Journal of Information Management Data Insights

V. Mary Anita Rajam¹  Thenuga Priyadharshini²  Santosh Kolagati² 

[1] Corresponding author at: Department of Computer Science and Engineering, CEG, Anna University, Chennai, India.;Department of Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, India;

关键词: CNN;    Multilayer perceptron;    Deepfake detection;    Mixed data;    classification;   

DOI  :  

来源: DOAJ

【 摘 要 】

Creating deepfakes has rapidly become easier and more accessible due to advancements in hardware and computing. The harmful nature of deepfakes urges immediate action to improve detection of such doctored videos. In this work, we build a deep hybrid neural network model to detect deepfake videos. Using facial landmarks detection, we extract data pertaining to various facial attributes from the videos. This data is passed to a multilayer perceptron to learn differences in real and deepfake videos. Simultaneously, we use a convolutional neural network to extract features and train on the videos. We combine these two models to build a multi-input deepfake detector. A subset of the Deepfake Detection Challenge Dataset along with the Dessa Dataset is used to train the model. The proposed model provides good classification results with an accuracy of 84% and an AuC score of 0.87.

【 授权许可】

Unknown