Speech Meets ELF: Audio Conditional Continuous-Target Diffusion for Speech Recognition and Translation

Xuanchen Li, Tianrui Wang, Yuheng Lu +11

Speech-to-text (S2T) systems for recognition (ASR) and translation (S2TT) typically generate discrete text tokens. In contrast, continuous-target language modelling performs genera…