Benchmarking and Revisiting Code Generation Assessment: A Mutation-Based Approach

Longtian Wang, Tianlin Li, Xiaofei Xie +3

Code Large Language Models (CLLMs) have exhibited outstanding performance in program synthesis, attracting the focus of the research community. The evaluation of CLLM's program syn…