6 papers
Hot Fixing in the Wild
Carol Hanna, Karine Even-Mendoza, W. B. Langdon +3
Despite the operational importance of hot fixes, large-scale evidence on how they reshape routine maintenance workflows, particularly in the era of autonomous coding agents, remain…
Unveiling Practical Shortcomings of Patch Overfitting Detection Techniques
David Williams, Ioakim Avraam, Aldeida Aleti +3
Automated Program Repair (APR) can reduce the time developers spend debugging, allowing them to focus on other aspects of software development. Automatically generated bug patches…
JMigBench: A Benchmark for Evaluating LLMs on Source Code Migration (Java 8 to Java 11)
Nishil Amin, Zhiwei Fei, Xiang Li +2
We build a benchmark to evaluate large language models (LLMs) for source code migration tasks, specifically upgrading functions from Java 8 to Java 11. We first collected a dataset…
Empirical and Sustainability Aspects of Software Engineering Research in the Era of Large Language Models: A Reflection
David Williams, Max Hort, Maria Kechagia +3
Software Engineering (SE) research involving the use of Large Language Models (LLMs) has introduced several new challenges related to rigour in benchmarking, contamination, replica…
HotBugs.jar: A Benchmark of Hot Fixes for Time-Critical Bugs
Carol Hanna, Federica Sarro, Mark Harman +1
Hot fixes are urgent, unplanned changes deployed to production systems to address time-critical issues. Despite their importance, no existing evaluation benchmark focuses specifica…
LLM-Guided Genetic Improvement: Envisioning Semantic Aware Automated Software Evolution
Karine Even-Mendoza, Alexander Brownlee, Alina Geiger +4
Genetic Improvement (GI) of software automatically creates alternative software versions that are improved according to certain properties of interests (e.g., running-time). Search…