2 papers
cs.LG2026
Dynamic Topology Optimization for Non-IID Data in Decentralized Learning
Bart Cox, Antreas Ioannou, Jérémie Decouchant
Decentralized learning (DL) enables a set of nodes to train a model collaboratively without central coordination, offering benefits for privacy and scalability. However, DL struggl…
cs.LG2025
Go With The Flow: Churn-Tolerant Decentralized Training of Large Language Models
Nikolay Blagoev, Bart Cox, Jérémie Decouchant +1
Motivated by the emergence of large language models (LLMs) and the importance of democratizing their training, we propose GWTF, the first crash tolerant practical decentralized tra…