Rubrics as Privileged Information for Open-Ended Generation

Deepika Bablani, Ajay Gupta, Wanming Chen

On-policy self-distillation (OPSD), where a single model acts as both student and teacher with different contexts, has shown promise in verifiable domains like math, where hard pri…