A Comprehensive Framework for Evaluating API-oriented Code Generation in Large Language Models

Yixi Wu, Pengfei He, Zehao Wang +3

Large language models (LLMs) like GitHub Copilot and ChatGPT have emerged as powerful tools for code generation, significantly enhancing productivity and accelerating software deve…