SeOPD: Self-Evolving LLMs via Online Policy Distillation from Self-Generated Chain-of-Thought

Xiaoshu Chen, Xiangyu Wong, Sihang Zhou +2

Recent advances in online policy self-distillation (OPSD) have demonstrated that large language models (LLMs) can improve their capabilities by leveraging external privileged infor…