Edge Deep Learning for Neural Implants

Abstract

Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain states appropriate for the therapeutic action. However, advanced algorithms that have shown promise in offline studies, in particular deep learning (DL) methods, have not been deployed on resource-restrained neural implants. Here, we designed and optimized three embedded DL models of commonly adopted architectures and evaluated their inference performance in a case study of seizure detection. A deep neural network (DNN), a convolutional neural network (CNN), and a long short-term memory (LSTM) network were designed to classify ictal, preictal, and interictal phases from the CHB-MIT scalp EEG database. After iterative model compression and quantization, the algorithms were deployed on a general-purpose, off-the-shelf microcontroller. Inference sensitivity, false positive rate, execution time, memory size, and power consumption were quantified. For seizure event detection, the sensitivity and FPR (h-1) for the DNN, CNN, and LSTM models were 87.36%/0.169, 96.70%/0.102, and 97.61%/0.071, respectively. Predicting seizures for early warnings was also feasible. The implemented compression and quantization achieved a significant saving of power and memory with an accuracy degradation of less than 0.5%. Edge DL models achieved performance comparable to many prior implementations that had no time or computational resource limitations. Generic microcontrollers can provide the required memory and computational resources, while model designs can be migrated to ASICs for further optimization. The results suggest that edge DL inference is a feasible option for future neural implants to improve classification performance and therapeutic outcomes.

arXiv comment25 pages, 7 figures, 3 tables

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
• Deep learning with convolutional neural networks for EEG decoding and visualization
• Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
• In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
• Mixed-Precision In-Memory Computing
• Focal onset seizure prediction using convolutional networks
• Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
• A Microprocessor implemented in 65nm CMOS with Configurable and Bit-scalable Accelerator for Programmable In-memory Computing
• Early Seizure Detection with an Energy-Efficient Convolutional Neural Network on an Implantable Microcontroller

Cited by in corpus (2)

• Combining SNNs with Filtering for Efficient Neural Decoding in Implantable Brain-Machine Interfaces
• Computationally efficient neural network classifiers for next generation closed loop neuromodulation therapy -- a case study in epilepsy