364 citations · 369 across the 3 of their papers we have counts for
3 papers
cs.LG2024★ 4 cited
PartIR: Composing SPMD Partitioning Strategies for Machine Learning
Sami Alabed, Daniel Belov, Bart Chrzaszcz +14
Training of modern large neural networks (NN) requires a combination of parallelization strategies encompassing data, model, or optimizer sharding. When strategies increase in comp…
cs.DC2022★ 1 cited
Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Sami Alabed, Dominik Grewe, Juliana Franco +6
Large neural network models are commonly trained through a combination of advanced parallelism strategies in a single program, multiple data (SPMD) paradigm. For example, training…
astro-ph.HE2017★ 364 cited
The evolutionary roads leading to low effective spins, high black hole masses, and O1/O2 rates of LIGO/Virgo binary black holes
K. Belczynski, J. Klencki, C. E. Fields +31
All ten LIGO/Virgo binary black hole (BH-BH) coalescences reported from the O1/O2 runs have near zero effective spins. There are only three potential explanations of this fact. If…