Overtaught, Underlearned: Learner-Centered Distillation from Multi-Agent Discussion

Mengtao Zhou, Jianxiao Wang, Xiupeng Chen +2

Multi-agent discussion produces reasoning collaboratively, while deployment still relies on a smaller student that must answer alone. Full-graph distillation transfers such discuss…