EEG based Continuous Speech Recognition using Transformers
arXiv:2001.00501
Abstract
In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model. Our results demonstrate that transformer based model demonstrate faster training compared to recurrent neural network (RNN) based sequence-to-sequence EEG models and better performance during inference time for smaller test set vocabulary but as we increase the vocabulary size, the performance of the RNN based models were better than transformer based model on a limited English vocabulary.
References in corpus (5)
- Adam: A Method for Stochastic Optimization
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Attention-Based Models for Speech Recognition
- State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG
- Improving EEG based Continuous Speech Recognition