Evaluating LLMs on Java Code Snippet Adaptation Using a Mutation-Injection Framework

Ali Aman, Muhammad Asaduzzaman, Shaowei Wang +1

Background: Developers frequently reuse code by copying fragments and adapting them to fit new contexts. Existing benchmarks for evaluating large language models (LLMs) on code ada…