Promising Accurate Prefix Boosting for sequence-to-sequence ASR
arXiv:1811.02770
Abstract
In this paper, we present promising accurate prefix boosting (PAPB), a discriminative training technique for attention based sequence-to-sequence (seq2seq) ASR. PAPB is devised to unify the training and testing scheme in an effective manner. The training procedure involves maximizing the score of each partial correct sequence obtained during beam search compared to other hypotheses. The training objective also includes minimization of token (character) error rate. PAPB shows its efficacy by achieving 10.8\% and 3.8\% WER with and without RNNLM respectively on Wall Street Journal dataset.
References in corpus (12)
- Adam: A Method for Stochastic Optimization
- ADADELTA: An Adaptive Learning Rate Method
- Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
- Sequence Level Training with Recurrent Neural Networks
- End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results
- An Actor-Critic Algorithm for Sequence Prediction
- Sequence-to-Sequence Learning as Beam-Search Optimization
- ESPnet: End-to-End Speech Processing Toolkit
- Search-based Structured Prediction
- Task Loss Estimation for Sequence Prediction
- End-to-end Speech Recognition with Word-based RNN Language Models
- Optimal Completion Distillation for Sequence Learning