Adapting Whisper for Streaming Speech Recognition via Two-Pass Decoding

Haoran Zhou, Xingchen Song, Brendan Fahy +9

OpenAI Whisper is a family of robust Automatic Speech Recognition (ASR) models trained on 680,000 hours of audio. However, its encoder-decoder architecture, trained with a sequence…