3k citations · 4.5k across the 3 of their papers we have counts for
3 papers
cs.LG2021★ 1.5k cited
Evaluating Large Language Models Trained on Code
Mark Chen, Jerry Tworek, Heewoo Jun +55
We introduce Codex, a GPT language model fine-tuned on publicly available code from GitHub, and study its Python code-writing capabilities. A distinct production version of Codex p…
cs.LG2021★ 4 cited
A Generalizable Approach to Learning Optimizers
Diogo Almeida, Clemens Winter, Jie Tang +1
A core issue with learning to optimize neural networks has been the lack of generalization to real world problems. To address this, we describe a system designed from a generalizat…
cs.CL2020★ 3k cited
Language Models are Few-Shot Learners
Tom B. Brown, Benjamin Mann, Nick Ryder +28
Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typicall…