Training and Inference Efficiency of Encoder-Decoder Speech Models

Piotr Żelasko, Kunal Dhawan, Daniel Galvez +7

Attention encoder-decoder model architecture is the backbone of several recent top performing foundation speech models: Whisper, Seamless, OWSM, and Canary-1B. However, the reporte…