From Self-Distillation to Self-Practice: Privileged Information for Multi-Turn Agents

Xingyu Su, Abhishek Kumar, Qing Ping +5

On-policy self-distillation (OPSD) has become a popular recipe for post-training LLM agents. It supervises the agent model at the token level with a stronger teacher view of the sa…