Lexicographic Multi-Objective On-Policy Distillation

Doseok Jang, Jon Ander Campos, Youran Qi

Reinforcement learning from verifiable rewards (RLVR) usually optimizes answer correctness, yet useful language-model behavior also requires high-quality reasoning and concise resp…