OPT: Open Pre-trained Transformer Language Models

Susan Zhang, Stephen Roller, Naman Goyal +16

Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning. Given their computatio…