Disproving Program Equivalence with LLMs

Miltiadis Allamanis, Pengcheng Yin

To evaluate large language models (LLMs) for code, research has used manually created unit test-based benchmarks. However, these tests are often inadequate, missing corner cases an…