ASSET: Adaptive Speech Segmentation via Reinforcement Learning

Cihan Xiao, Yuan Tseng, Matthew Wiesner +4

Speech large language models (LLMs) are often built using pretrained acoustic encoders as an audio interface to an LLM decoder. However, LLMs scale poorly with input sequence lengt…