Training Language Models to Win Debates with Self-Play Improves Judge Accuracy

Samuel Arnesen, David Rein, Julian Michael

We test the robustness of debate as a method of scalable oversight by training models to debate with data generated via self-play. In a long-context reading comprehension task, we…