Comparing large language models and human programmers for generating programming code

Wenpin Hou, Zhicheng Ji

We systematically evaluated the performance of seven large language models in generating programming code using various prompt strategies, programming languages, and task difficult…