A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications

Abstract

In recent years, the field of electroencephalography (EEG) analysis has witnessed remarkable advancements, driven by the integration of machine learning and artificial intelligence. This survey aims to encapsulate the latest developments, focusing on emerging methods and technologies that are poised to transform our comprehension and interpretation of brain activity. We delve into self-supervised learning methods that enable the robust representation of brain signals, which are fundamental for a variety of downstream applications. We also explore emerging discriminative methods, including graph neural networks (GNN), foundation models, and large language models (LLMs)-based approaches. Furthermore, we examine generative technologies that harness EEG data to produce images or text, offering novel perspectives on brain activity visualization and interpretation. The survey provides an extensive overview of these cutting-edge techniques, their current applications, and the profound implications they hold for future research and clinical practice. The relevant literature and open-source materials have been compiled and are consistently being refreshed at \url{https://github.com/wpf535236337/LLMs4TS}

submitted to IECE Chinese Journal of Information Fusion

References in corpus (54)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Distilling the Knowledge in a Neural Network
• Decoupled Weight Decay Regularization
• A Simple Framework for Contrastive Learning of Visual Representations
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• LLaMA: Open and Efficient Foundation Language Models
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
• Comparing community structure identification
• Llama 2: Open Foundation and Fine-Tuned Chat Models
• LoRA: Low-Rank Adaptation of Large Language Models
• On the Opportunities and Risks of Foundation Models
• Recurrent Neural Network Regularization
• Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
• Training Generative Adversarial Networks with Limited Data
• KAN: Kolmogorov-Arnold Networks
• Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
• Foundation Models for Time Series Analysis: A Tutorial and Survey
• MOABB: Trustworthy algorithm benchmarking for BCIs
• K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations
• One Fits All:Power General Time Series Analysis by Pretrained LM
• Gated Transformer Networks for Multivariate Time Series Classification
• Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
• Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
• Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis
• EEG-GCNN: Augmenting Electroencephalogram-based Neurological Disease Diagnosis using a Domain-guided Graph Convolutional Neural Network
• TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting
• TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders
• Are Language Models Actually Useful for Time Series Forecasting?
• Large-scale Training of Foundation Models for Wearable Biosignals
• TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Series
• A Survey on Diffusion Models for Time Series and Spatio-Temporal Data
• Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI
• SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing
• Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Series
• DreamDiffusion: Generating High-Quality Images from Brain EEG Signals
• MAEEG: Masked Auto-encoder for EEG Representation Learning
• BrainBERT: Self-supervised representation learning for intracranial recordings
• Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder
• Large Language Models for Time Series: A Survey
• Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Tasks
• Seeing through the Brain: Image Reconstruction of Visual Perception from Human Brain Signals
• Mixture-of-Linear-Experts for Long-term Time Series Forecasting
• EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Model
• Understanding the Role of Textual Prompts in LLM for Time Series Forecasting: an Adapter View
• CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuning
• BrainWave: A Brain Signal Foundation Model for Clinical Applications
• SleepPriorCL: Contrastive Representation Learning with Prior Knowledge-based Positive Mining and Adaptive Temperature for Sleep Staging
• ECG Semantic Integrator (ESI): A Foundation ECG Model Pretrained with LLM-Enhanced Cardiological Text
• Graph Generation Powered with LLMs for Boosting Multivariate Time-Series Representation Learning
• Understanding Why Large Language Models Can Be Ineffective in Time Series Analysis: The Impact of Modality Alignment
• Cross-Domain Pre-training with Language Models for Transferable Time Series Representations
• Advancing Time Series Classification with Multimodal Language Modeling
• A Knowledge-Driven Cross-view Contrastive Learning for EEG Representation