17 citations · 61 across the 17 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023★ 7 cited
DiLoCo: Distributed Low-Communication Training of Language Models
Arthur Douillard, Qixuan Feng, Andrei A. Rusu +6
Large language models (LLM) have become a critical component in many applications of machine learning. However, standard approaches to training LLM require a large number of tightl…
cs.LG2023★ 2 cited
Towards Compute-Optimal Transfer Learning
Massimo Caccia, Alexandre Galashov, Arthur Douillard +6
The field of transfer learning is undergoing a significant shift with the introduction of large pretrained models which have demonstrated strong adaptability to a variety of downst…