2.4k citations · 6.2k across the 17 of their papers we have counts for
1 paper · 1 filter
Binhang Yuan, Yongjun He, Jared Quincy Davis +6
Training foundation models, such as GPT-3 and PaLM, can be extremely expensive, often involving tens of thousands of GPUs running continuously for months. These models are typicall…