#teacher‑student distillation
topicteacher‑student distillation
2 papers · 1 filter
cs.LG2026
Beyond the Best Teacher: Expanding and Compressing the Reasoning Solution Manifold
Songshuo Lu, Zhi Chen, Yaohua Tang
The paper proposes an expand‑then‑compress framework that builds a diverse set of RL‑trained teacher models and then distills them into a single student model, improving reasoning,…
cs.CV2026
From Hindsight to Foresight: Self-Encouraged Hindsight Distillation for Knowledge-based Visual Question Answering
Yu Zhao, Ying Zhang, Xuhui Sui +4
The paper introduces a teacher‑student framework called Hindsight Distillation (HinD) that uses privileged answer information to generate reasoning trajectories for a multimodal LL…