works on
code generation 2large language models 2reinforcement learning 2adversarial red-teaming 1distribution matching 1generative flow networks 1knowledge distillation 1on-policy distillation 1

From the 2 of 9 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Weak-to-Strong On-Policy Distillation

Fangxu Yu, Zinan Lin, Xiaodong Liu +4

The paper proposes Weak-to-Strong On-Policy Distillation (W2S-OPD), a method that improves a large language model by distilling knowledge from multiple weaker models using a constr…