Deep Learning Model With Adaptive Regularization for EEG-Based Emotion Recognition Using Temporal and Frequency Features

IEEE Access

Bentolhoda Ayati¹  Alireza Samavat¹  Ebrahim Khalili²  Marzieh Ayati³ 

[1] Department of Biomedical Engineering, Islamic Azad University of Tehran-Central Branch, Tehran, Iran;Department of Biomedical Engineering, University of Tarbiat Modares, Tehran, Iran;Department of Computer Science, University of Texas Rio Grande Valley, Edinburg, TX, USA;

关键词: EEG;    emotion recognition;    deep learning;   

DOI  :  10.1109/ACCESS.2022.3155647

来源: DOAJ

【 摘 要 】

Since EEG signal acquisition is non-invasive and portable, it is convenient to be used for different applications. Recognizing emotions based on Brain-Computer Interface (BCI) is an important active BCI paradigm for recognizing the inner state of persons. There are extensive studies about emotion recognition, most of which heavily rely on staged complex handcrafted EEG feature extraction and classifier design. In this paper, we propose a hybrid multi-input deep model with convolution neural networks (CNNs) and bidirectional Long Short-term Memory (Bi-LSTM). CNNs extract time-invariant features from raw EEG data, and Bi-LSTM allows long-range lateral interactions between features. First, we propose a novel hybrid multi-input deep learning approach for emotion recognition from raw EEG signals. Second, in the first layers, we use two CNNs with small and large filter sizes to extract temporal and frequency features from each raw EEG epoch of 62-channel 2-s and merge with differential entropy of EEG band. Third, we apply the adaptive regularization method over each parallel CNN’s layer to consider the spatial information of EEG acquisition electrodes. The proposed method is evaluated on two public datasets, SEED and DEAP. Our results show that our technique can significantly improve the accuracy in comparison with the baseline where no adaptive regularization techniques are used.

【 授权许可】

Unknown