11 citations · 11 across the 4 of their papers we have counts for
1 paper · 1 filter
Aasheesh Singh, Vishal Vaddina, Dagnachew Birru
We introduce ORPO-Distill, a general-purpose method for cross-architecture LLM distillation that formulates the problem as a preference optimization task. Unlike standard CoT disti…