Accelerating Visual On-Policy Distillation with Batched Speculative Jacobi Rollouts

Bingqi Shan, Zhehao Yu, Kenhong Lin +1

Visual on-policy distillation (OPD) improves the training of compact visual autoregressive models by learning from trajectories generated by the current student. However, these onl…