How to Connect Speech Foundation Models and Large Language Models? What Matters and What Does Not

Francesco Verdini, Pierfrancesco Melucci, Stefano Perna +9

The remarkable performance achieved by Large Language Models (LLM) has driven research efforts to leverage them for a wide range of tasks and input modalities. In speech-to-text (S…