2 papers
cs.DC2026
HeLoCo: Efficient asynchronous low-communication training under data and device heterogeneity
Abdullah Al Asif, Patrick Diem, Juan Pablo Muñoz +3
Distributed Low-Communication (DiLoCo) training reduces communication overhead by allowing workers to perform multiple local optimization steps before sending pseudo-gradients to a…
cs.PF2025
Denoising Application Performance Models with Noise-Resilient Priors
Gustavo de Morais, Alexander GeiÃ, Alexandru Calotoiu +5
As parallel codes are scaled to larger computing systems, performance models play a crucial role in identifying potential bottlenecks. However, constructing these models analytical…