Accelerating Distributed Stochastic Optimization via Self-Repellent Random Walks

Jie Hu, Vishwaraj Doshi, Do Young Eun

We study a family of distributed stochastic optimization algorithms where gradients are sampled by a token traversing a network of agents in random-walk fashion. Typically, these r…