Brain-inspired Computing Based on Deep Learning for Human-computer Interaction: A Review

Abstract

The continuous development of artificial intelligence has a profound impact on biomedicine and other fields, providing new research ideas and technical methods. Brain-inspired computing is an important intersection between multimodal technology and biomedical field. Focusing on the application scenarios of decoding text and speech from brain signals in human-computer interaction, this paper presents a comprehensive review of the brain-inspired computing models based on deep learning (DL), tracking its evolution, application value, challenges and potential research trends. We first reviews its basic concepts and development history, and divides its evolution into two stages: recent machine learning and current deep learning, emphasizing the importance of each stage in the research of brain-inspired computing for human-computer interaction. In addition, the latest progress of deep learning in different tasks of brain-inspired computing for human-computer interaction is reviewed from five perspectives, including datasets and different brain signals, and the application of key technologies in the model is elaborated in detail. Despite significant advances in brain-inspired computational models, challenges remain to fully exploit their capabilities, and we provide insights into possible directions for future academic research. For more detailed information, please visit our GitHub page: https://github.com/ultracoolHub/brain-inspired-computing.

26pages, 8 figures and 4 tables

References in corpus (19)

• Deep learning with convolutional neural networks for EEG decoding and visualization
• Sparks of Artificial General Intelligence: Early experiments with GPT-4
• Brain-inspired computing: We need a master plan
• Spiking Neural Networks Hardware Implementations and Challenges: a Survey
• Decoding speech perception from non-invasive brain recordings
• Defecting or not defecting: how to "read" human behavior during cooperative games by EEG measurements
• BrainCog: A Spiking Neural Network based Brain-inspired Cognitive Intelligence Engine for Brain-inspired AI and Brain Simulation
• State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG
• ZuCo 2.0: A Dataset of Physiological Recordings During Natural Reading and Annotation
• MAtt: A Manifold Attention Network for EEG Decoding
• SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG
• DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translation
• Simple method for detecting sleep episodes in rats ECoG using machine learning
• Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey
• Transfer Learning with Active Sampling for Rapid Training and Calibration in BCI-P300 Across Health States and Multi-centre Data
• Large Transformers are Better EEG Learners
• Evaluating Latent Space Robustness and Uncertainty of EEG-ML Models under Realistic Distribution Shifts
• Deep learning for ECoG brain-computer interface: end-to-end vs. hand-crafted features
• UniBrain: A Unified Model for Cross-Subject Brain Decoding