Physics-Guided Policy Optimization with Self-Distillation

Ke Wang, Yuning Wu, Haoran Liu +3

Self-distilled policy optimization (SDPO) has become a popular paradigm for LLM post-training, where a model learns from its own predictions conditioned on privileged information.…