Program Semantic Inequivalence Game with Large Language Models

Antonio Valerio Miceli-Barone, Vaishak Belle, Ali Payani

Large Language Models (LLMs) can achieve strong performance on everyday coding tasks, but they can fail on complex tasks that require non-trivial reasoning about program semantics.…