Machine learning based medical image deepfake detection: A comparative study

Machine Learning with Applications

Yuxin Wen¹  Siddharth Solaiyappan² 

[1] Dale E. and Sarah Ann Fowler School of Engineering, Chapman University, Orange, CA 92866, USA;Northwood High School, Irvine Unified School District, Irvine, CA 92620, USA;

关键词: Computed tomography;    Generative adversarial networks;    Deepfake detection;    DICOM;    Tampered images;    Machine learning;   

DOI  :  

来源: DOAJ

【 摘 要 】

Deep generative networks in recent years have reinforced the need for caution while consuming various modalities of digital information. One avenue of deepfake creation is aligned with injection and removal of tumors from medical scans. Failure to detect medical deepfakes can lead to large setbacks on hospital resources or even loss of life. This paper attempts to address the detection of such attacks with a structured case study. Specifically, we evaluate eight different machine learning algorithms, which include three conventional machine learning methods (Support Vector Machine, Random Forest, Decision Tree) and five deep learning models (DenseNet121, DenseNet201, ResNet50, ResNet101, VGG19) in distinguishing between tampered and untampered images. For deep learning models, the five models are used for feature extraction, then each pre-trained model is fine-tuned. The findings of this work show near perfect accuracy in detecting instances of tumor injections and removals.

【 授权许可】

Unknown