Language Models are Few-Shot Learners

Tom B. Brown, Benjamin Mann, Nick Ryder +28

Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typicall…