Route-and-Generate: KL-Regularized Router Improvement for Reasoning Routing in LLMs

Tien-Phat Nguyen, Truong Nguyen, Thanh-Thien Le +4

Large language models often apply complex reasoning indiscriminately, leading to overthinking on simple tasks and underthinking on harder ones. We present Route-and-Generate (Rouge…