1 citations · 1 across the 9 of their papers we have counts for
5 papers · 1 filter
Learning to Steer, Steering to See: Unveiling the Geometry of RLVR in Large Language Models via Trainable Vectors
Yuchen Cai, Ding Cao, Qixiang Yin +10
Reinforcement learning (RL) has become a key paradigm for enhancing the reasoning of large language models, yet the high dimensionality of parameter updates makes its training dyna…
Distill What You Trust: Reliability-Aware Multi-Teacher On-Policy Distillation
Jie Sun, Mao Zheng, Mingyang Song +8
Multi-teacher on-policy distillation allows a student to learn from complementary specialists on its own trajectories. Domain-routed approaches, however, select one teacher per exa…
Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms
Siye Wu, Kai Yang, Yuchen Cai +8
Reinforcement learning with verifiable rewards (RLVR) improves specific capabilities of large language models, but covering multiple capabilities often involves training separate d…
H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation
Qixiang Yin, Huanjin Yao, Yuchen Cai +5
On-policy distillation (OPD) has recently emerged as an effective post-training paradigm by providing supervision on student-generated trajectories. However, existing OPD methods f…
Learning to Foresee: Unveiling the Unlocking Efficiency of On-Policy Distillation
Yuchen Cai, Ding Cao, Liang Lin +9
On-policy distillation (OPD) has emerged as an efficient post-training paradigm for large language models. However, existing studies largely attribute this advantage to denser and…