Adapting Speech Foundation Models for Unified Multimodal Speech Recognition with Large Language Models

Jing-Xuan Zhang, Genshun Wan, Jin Li +3

While speech foundation models (SFMs) have demonstrated remarkable performance in audio-only tasks, their adaptation to multimodal scenarios remains underexplored. This work presen…