Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models

Frank F. Yang, Kefei Yan, Yiren Wang +1

Improving the reasoning capabilities of vision-language models (VLMs) often relies on post-training with supervision from stronger models. Two common strategies are supervised fine…