Continuous Speech Recognition using EEG and Video
arXiv:1912.07730
Abstract
In this paper we investigate whether electroencephalography (EEG) features can be used to improve the performance of continuous visual speech recognition systems. We implemented a connectionist temporal classification (CTC) based end-to-end automatic speech recognition (ASR) model for performing recognition. Our results demonstrate that EEG features are helpful in enhancing the performance of continuous visual speech recognition systems.
On preparation for submission to EUSIPCO 2020. arXiv admin note: text overlap with arXiv:1911.11610, arXiv:1911.04261
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
- Deep Learning using Rectified Linear Units (ReLU)
- Deep Audio-Visual Speech Recognition
- LipNet: End-to-End Sentence-level Lipreading
- State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG