exploration dynamics 1large language models 1length exploitation 1on-policy distillation 1teacher-student mismatch 1
From the 1 of 5 linked papers with an AI index.
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations
Rui Wang, Hongru Wang, Yi Chen +4
The paper investigates how on-policy distillation guides large language model students during training, identifies two main failure modes—student‑teacher mismatch and length exploi…
cs.CL2026
WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Models
Rui Wang, Ce Zhang, Jun-Yu Ma +10
The hallmark of Deep Research agents lies in compositional reasoning, the capacity to aggregate distributed, heterogeneous information into coherent logical insights. However, curr…