Deep Recurrent Semi-Supervised EEG Representation Learning for Emotion Recognition

Abstract

EEG-based emotion recognition often requires sufficient labeled training samples to build an effective computational model. Labeling EEG data, on the other hand, is often expensive and time-consuming. To tackle this problem and reduce the need for output labels in the context of EEG-based emotion recognition, we propose a semi-supervised pipeline to jointly exploit both unlabeled and labeled data for learning EEG representations. Our semi-supervised framework consists of both unsupervised and supervised components. The unsupervised part maximizes the consistency between original and reconstructed input data using an autoencoder, while simultaneously the supervised part minimizes the cross-entropy between the input and output labels. We evaluate our framework using both a stacked autoencoder and an attention-based recurrent autoencoder. We test our framework on the large-scale SEED EEG dataset and compare our results with several other popular semi-supervised methods. Our semi-supervised framework with a deep attention-based recurrent autoencoder consistently outperforms the benchmark methods, even when small sub-sets (3\%, 5\% and 10\%) of the output labels are available during training, achieving a new state-of-the-art semi-supervised performance.

arXiv commentAccepted by 9th International Conference on Affective Computing and Intelligent Interaction (ACII 2021)

References in corpus (6)

• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Temporal Ensembling for Semi-Supervised Learning
• Spatial-Temporal Recurrent Neural Network for Emotion Recognition
• Realistic Evaluation of Deep Semi-Supervised Learning Algorithms
• Capsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation
• A Novel Bi-hemispheric Discrepancy Model for EEG Emotion Recognition