29 citations · 34 across the 6 of their papers we have counts for
1 paper · 1 filter
Haixu Ma, Saad Lahrichi, Weiwei Li +11
Black-box On-Policy Distillation (OPD) seeks to improve a student from its own generations when the teacher provides sampled responses but not token probabilities. Adversarial dist…