works on
code generation 1knowledge distillation 1large language models 1on-policy distillation 1reinforcement learning 1

From the 1 of 2 linked papers with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Weak-to-Strong On-Policy Distillation

Fangxu Yu, Zinan Lin, Xiaodong Liu +4

The paper proposes Weak-to-Strong On-Policy Distillation (W2S-OPD), a method that improves a large language model by distilling knowledge from multiple weaker models using a constr…