Attention and residual mechanism-based CNN architecture (ARC-Net) with enhanced fairness generalization for deepfake facial image detection.
Clinical Snapshot
PICO Framework
| P — Population | Digital facial images including 500 real images from Bangladesh and 140,000 real and fake faces from existing datasets |
| I — Intervention | ARC-Net (Attention and Residual mechanism-based CNN) architecture with EfficientNet B0 base |
| C — Comparator | Four pre-trained deep learning models and traditional methods |
| O — Outcomes | Deepfake detection accuracy, precision, recall, F1-score, out-of-distribution generalization, fairness metrics |
Bottom Line
ARC-Net represents a promising advancement in deepfake detection technology, achieving exceptional performance metrics through innovative combination of attention mechanisms and residual networks. The study demonstrates strong technical merit with comprehensive evaluation including fairness assessment and explainable AI components. However, the reported 99% accuracy raises questions about potential overfitting, and the limited geographic diversity in training data may impact generalizability. The technology shows particular promise for cybersecurity applications and digital forensics, though real-world deployment would require careful validation across diverse populations and deepfake generation techniques. Australian organizations involved in digital security and media authentication could benefit from this approach, particularly given the growing threat of sophisticated deepfake content in misinformation campaigns.
Key Findings
P Value: Statistical significance confirmed via McNemar's test (specific p-value not provided)
Effect Size: Precision: 1.0, Recall: 0.97, F1-score: 0.98
Primary Outcome: Deepfake detection accuracy of 99%
Nnt Or Sensitivity: Sensitivity (recall): 0.97, Specificity: implied high based on precision of 1.0
Confidence Interval: Not explicitly reported
Clinical Application
Requires computational resources and technical expertise for implementation Relevant for Australian cybersecurity agencies, media organizations, and law enforcement dealing with digital misinformation and fraud prevention Digital forensics professionals, cybersecurity teams, media authentication services
Abstract
Deepfake (DF) content poses a major challenge to digital media authentication, that can mimic facial movements, creating realistic replicas that risk spreading misinformation and enabling harassment, as can be seen in Bangladesh. Previous studies applied residual convolutional blocks or attention mechanisms for DF detection; however, these approaches often treat these components in isolation and lack explicit consideration of fairness, out-of-distribution generalization, statistical analysis or artifact-focused detection. Our study introduces an approach, called ARC-Net, which uses a combination of attention and residual convolutional layers along with the EfficientNet B0 base, the attention mechanism of which allows the model to pay more attention to details that could resemble the ones seen in non-perfectly executed DF, which enhances the model's potential to distinguish them, addressing limitations in pre-trained and also advanced DL models. A dataset of 500 real images from Bangladesh combined with a 140k real and fake faces dataset was used to train and test our model alongside four pre-trained DL models. ARC-Net performed much better than the other traditional and state of art methods with 99% accuracy, 1.0 precision, 0.97 recall and 0.98 F1 score, reaching the highest level of reliability in spotting DF images. To assess the external reliability and generalizability of ARC-Net, the model was evaluated on the Deepfake Dataset and the Deepfake Database datasets, achieving consistently high and balanced performance across different scales. Three out-of-distribution (OOD) experiments were conducted, where the first one evaluated South Asian images, showing that incorporating fewer than one percent real Bangladeshi images reduced the false positive rate by more than half and improved probability calibration, while the remaining two cross-dataset experiments demonstrated strong transferability. An ablation study further showed the impact of different components within a model by systematically removing or modifying them and statistical significance between competing classifiers was assessed using McNemar's Statistical test. In addition, we've applied Explainable AI (XAI) techniques, Grad-CAM and LIME to offer transparency of the results, as giving attention to the facial region is also important for DF detection. This study will help advance DF detection by integrating ARC-Net's attention-residual mechanisms and XAI, offering insights for developing models in security and media forensics.
References
- 1.Reza, M. S., Elias, F., Mahmud, M. I., & Ahmed, N. (2024). Attention and residual mechanism-based CNN architecture (ARC-Net) with enhanced fairness generalization for deepfake facial image detection. PLoS One, 19(12), e0340099. https://doi.org/10.1371/journal.pone.0340099
This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service