Phoneme-Guided Initialization for LLM-based Speech Recognition

Ryo Magoshi, Shinsuke Sakai, Tatsuya Kawahara

Speech large language models (speech LLMs) perform well on automatic speech recognition (ASR) when sufficient paired speech-text data is available, but their performance degrades i…