A two-stage deep learning approach for facial emotion recognition in RAVDESS videos

Scientific Reports

卷:16

Article

Achraf Jallaglag¹  My Abdelouahed Sabri¹  Ali Yahyaouy¹  Abdellah Aarab² 

[1] Physics Department, Faculty of Sciences, University Sidi Mohamed Ben Abdallah, Fes, Morocco

[2] Computer Science Department, Faculty of Sciences, University Sidi Mohamed Ben Abdallah, Fez, Morocco

关键词: Emotion recognition;    Deep learning;    Convolutional neural network (CNN);    Dataset;    Facial expression analysis;    Video-based emotion recognition;    Transfer learning;    Affective computing;   

DOI  :  10.1038/s41598-026-60089-6

 received in 2026-03-20, accepted in 2026-06-25,  发布年份 2026

来源: Springer

【 摘 要 】

Video-based emotion recognition is an important topic in affective computing, with applications in human–computer interaction, mental health, and multimedia systems. In this work, we propose a two-stage deep learning approach that extracts spatial features from individual frames and leverages temporal consistency across video sequences for facial expression recognition using the RAVDESS dataset. First, videos are split into frames, and a fine-tuned VGG16 CNN extracts discriminative spatial features from each frame. Second, these features are aggregated into sequences and the frame-level predictions are aggregated at the video level using a majority voting strategy to ensure temporal consistency. Our experiments show that the proposed method achieves 93.6% accuracy at the frame level and 98.1% at the video level, outperforming baseline models and remaining competitive with recent state-of-the-art approaches. Temporal aggregation helps reduce misclassifications of subtle emotions, while fine-tuning improves feature extraction. The approach is computationally efficient and provides a solid foundation for future research in multimodal emotion recognition and advanced video-level aggregation.

【 授权许可】

CC BY   
© The Author(s) 2026

【 图 表 】

2

Fig. 2

Fig. 5

Fig. 2

Fig. 2

Fig. 7