Self-Improvement as Coherence Optimization: A Theoretical Account

Tianyi Qiu, Ahmed Hani Ismail, Zhonghao He +1

Can language models improve their accuracy without external supervision? Methods such as debate, bootstrap, and internal coherence maximization achieve this surprising feat, even m…