Accelerating RNN Transducer Inference via One-Step Constrained Beam Search

Juntae Kim, Yoonhan Lee

We propose a one-step constrained (OSC) beam search to accelerate recurrent neural network (RNN) transducer (RNN-T) inference. The original RNN-T beam search has a while-loop leadi…