NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Junkai Chen, Zhenhao Li, Xing Hu +1

Large language models (LLMs) achieve promising results in code generation based on a given natural language description. They have been integrated into open-source projects and com…