672 citations · 2.1k across the 11 of their papers we have counts for
1 paper · 1 filter
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch +19
We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget. We find that current large language models are si…