Approaching Dialogue State Tracking via Aligning Speech Encoders and LLMs

Šimon Sedláček, Bolaji Yusuf, Ján Švec +4

In this work, we approach spoken Dialogue State Tracking (DST) by bridging the representation spaces of speech encoders and LLMs via a small connector module, with a focus on fully…