Evaluating Large Language Models Trained on Code

Mark Chen, Jerry Tworek, Heewoo Jun +55

We introduce Codex, a GPT language model fine-tuned on publicly available code from GitHub, and study its Python code-writing capabilities. A distinct production version of Codex p…