7 papers
Smaller Models, Unexpected Costs: Trade-offs in LLM Quantization for Automated Program Repair
Fernando Vallecillos-Ruiz, Giordano d'Aloisio, Max Hort +3
Large Language Models (LLMs) are powerful tools and have been increasingly adopted for complex software engineering tasks. As the number of parameters increases, results can often…
Wisdom and Delusion of LLM Ensembles for Code Generation and Repair
Fernando Vallecillos-Ruiz, Max Hort, Leon Moonen
Today's pursuit of a single Large Language Model (LMM) for all software engineering tasks is resource-intensive and overlooks the potential benefits of complementarity, where diffe…
Assessing the Latent Automated Program Repair Capabilities of Large Language Models using Round-Trip Translation
Fernando Vallecillos Ruiz, Anastasiia Grishina, Max Hort +1
Research shows that errors in natural language can be corrected by translating texts to another language and back using language models. We explore to what extent this latent corre…
The Impact of Fine-tuning Large Language Models on Automated Program Repair
Roman MacháÄek, Anastasiia Grishina, Max Hort +1
Automated Program Repair (APR) uses various tools and techniques to help developers achieve functional and error-free code faster. In recent years, Large Language Models (LLMs) hav…
The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Models
Fernando Vallecillos Ruiz, Max Hort, Leon Moonen
Automatic program repair (APR) aims to reduce the manual efforts required to identify and fix errors in source code. Before the rise of LLM-based agents, a common strategy was to i…
Codehacks: A Dataset of Adversarial Tests for Competitive Programming Problems Obtained from Codeforces
Max Hort, Leon Moonen
Software is used in critical applications in our day-to-day life and it is important to ensure its correctness. One popular approach to assess correctness is to evaluate software o…