Do Factual Recall Mechanisms Carry over from Text to Speech in Multimodal Language Models?

Luca Modica, Filip Landin, Mehrdad Farahani +3

In recent years, several Speech Language Models (SLMs) that represent speech and written text jointly have been presented. The question then emerges about how model-internal mechan…