The Role of Feedback Alignment in Self-Distillation

Semih Kara, Oğuzhan Ersoy

Conditioning a language model on additional context, such as feedback on a previous attempt, typically improves its response. Self-distillation trains the model to retain this impr…