#multi‑teacher aggregation

Beyond the Best Teacher: Expanding and Compressing the Reasoning Solution Manifold

Songshuo Lu, Zhi Chen, Yaohua Tang

The paper proposes an expand‑then‑compress framework that builds a diverse set of RL‑trained teacher models and then distills them into a single student model, improving reasoning,…