CSLP-AE: A Contrastive Split-Latent Permutation Autoencoder Framework for Zero-Shot Electroencephalography Signal Conversion

Abstract

Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise and variability across subjects hampering generalizable signal extraction. Therefore, a key aim in EEG analysis is to extract the underlying neural activation (content) as well as to account for the individual subject variability (style). We hypothesize that the ability to convert EEG signals between tasks and subjects requires the extraction of latent representations accounting for content and style. Inspired by recent advancements in voice conversion technologies, we propose a novel contrastive split-latent permutation autoencoder (CSLP-AE) framework that directly optimizes for EEG conversion. Importantly, the latent representations are guided using contrastive learning to promote the latent splits to explicitly represent subject (style) and task (content). We contrast CSLP-AE to conventional supervised, unsupervised (AE), and self-supervised (contrastive learning) training and find that the proposed approach provides favorable generalizable characterizations of subject and task. Importantly, the procedure also enables zero-shot conversion between unseen subjects. While the present work only considers conversion of EEG, the proposed CSLP-AE provides a general framework for signal conversion and extraction of content (task activation) and style (subject variability) components of general interest for the modeling and analysis of biological signals.

arXiv commentAccepted for publication at the 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

References in corpus (18)

• XGBoost: A Scalable Tree Boosting System
• Auto-Encoding Variational Bayes
• A Simple Framework for Contrastive Learning of Visual Representations
• Representation Learning with Contrastive Predictive Coding
• WaveNet: A Generative Model for Raw Audio
• Instance Normalization: The Missing Ingredient for Fast Stylization
• SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging
• SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approach
• SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantification
• Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
• XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
• Self-supervised learning methods and applications in medical imaging analysis: A survey
• AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss
• Feature Learning from Incomplete EEG with Denoising Autoencoder
• An Accurate EEGNet-based Motor-Imagery Brain-Computer Interface for Low-Power Edge Computing
• Learning Subject-Invariant Representations from Speech-Evoked EEG Using Variational Autoencoders
• Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Data
• Multi-Person Brain Activity Recognition via Comprehensive EEG Signal Analysis