Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understanding

Mingqiu Wang, Izhak Shafran, Hagen Soltau +4

Large Language Models (LLMs) have been applied in the speech domain, often incurring a performance drop due to misaligned between speech and language representations. To bridge thi…