2 papers
cs.SE2026
PonyEval: Evaluating LLM-Based Program Repair for Capability-Safe and Actor-Oriented Pony Software
Bang Xie, Hao Liu, Zhenyu Shi +8
Repository-level issue-resolution benchmarks have made executable evaluation central to software-engineering agents, but their language coverage remains concentrated in mainstream…
cs.SE2026
OdinEval: A Reproducible Benchmark for LLM-Based Program Repair in the Odin Programming Language
Bang Xie, Hao Liu, Zhiyuan Peng +8
Repository-level repair benchmarks still center on a few mainstream languages, leaving systems languages such as Odin largely untested. We present OdinEval, a reproducible benchmar…