X-OPD: Cross-Modal On-Policy Distillation for Capability Alignment in Speech LLMs

Di Cao, Dongjie Fu, Hai Yu +3

While the shift from cascaded dialogue systems to end-to-end (E2E) speech Large Language Models (LLMs) improves latency and paralinguistic modeling, E2E models often exhibit a sign…