26 citations · 41 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CY2024★ 26 cited
The rising costs of training frontier AI models
Ben Cottier, Robi Rahman, Loredana Fattorini +3
The costs of training frontier AI models have grown dramatically in recent years, but there is limited public data on the magnitude and growth of these expenses. This paper develop…
cs.CL2024★ 13 cited
Algorithmic progress in language models
Anson Ho, Tamay Besiroglu, Ege Erdil +6
We investigate the rate at which algorithms for pre-training language models have improved since the advent of deep learning. Using a dataset of over 200 language model evaluations…