2 papers
cs.SE2026
OdinEval: A Reproducible Benchmark for LLM-Based Program Repair in the Odin Programming Language
Bang Xie, Hao Liu, Zhiyuan Peng +8
Repository-level repair benchmarks still center on a few mainstream languages, leaving systems languages such as Odin largely untested. We present OdinEval, a reproducible benchmar…
cs.SE2026
AppEval: A Unified Benchmark for LLM-Based Mobile Application Repair in ArkTS, Swift, and Kotlin
Bang Xie, Hao Liu, Zhenyu Shi +11
Repository-level LLM agents are typically evaluated on projects whose tests run on the build host. It remains unclear whether their repairs survive the mobile build-install-launch-…