Smaller Models, Unexpected Costs: Trade-offs in LLM Quantization for Automated Program Repair

Fernando Vallecillos-Ruiz, Giordano d'Aloisio, Max Hort +3

Large Language Models (LLMs) are powerful tools and have been increasingly adopted for complex software engineering tasks. As the number of parameters increases, results can often…