Beyond Encoder Fusion: Multi-View Discrete Token Augmentation for LLM-Based ASR

Paul Moïse Gangbadja, Mickael Rouvier, Fabrice Lefèvre

Discrete speech tokens provide a compact interface between speech encoders and large language models for automatic speech recognition, but single-tokenization systems remain sensit…