4 papers · 1 filter
Conflict-Aware Logit Adapters for Utility-Preserving Anti-Distillation
Quoc Phong Dao, Binh Anh Nguyen, Linh Ngo Van +3
While reasoning traces improve model capability, they also provide supervision signals for downstream distillation. Initial efforts to mitigate this issue rely on decoding-time int…
Route-and-Generate: KL-Regularized Router Improvement for Reasoning Routing in LLMs
Tien-Phat Nguyen, Truong Nguyen, Thanh-Thien Le +4
Large language models often apply complex reasoning indiscriminately, leading to overthinking on simple tasks and underthinking on harder ones. We present Route-and-Generate (Rouge…
Rationale-Guided Policy Optimization: Learning to Reason with Adaptive Rationale Scaffolding
Hoang Phan, Minh Pham, Chau Pham +3
On-policy reinforcement learning has become a central paradigm for improving the reasoning abilities of large language models. However, its effectiveness is often limited by reward…
Selective Off-Policy Reference Tuning with Plan Guidance
Duc Anh Le, Anh Duc, Tien-Phat Nguyen +3
Reinforcement learning with verifiable rewards helps reasoning, but GRPO-style methods stall on hard prompts where all sampled rollouts fail. SORT adds a repair update for those fa…