Showing cs.LGShow all
3 papers · 1 filter
cs.LG2022
Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD
Bapi Chatterjee, Vyacheslav Kungurtsev, Dan Alistarh
Powered by the simplicity of lock-free asynchrony, Hogwilld! is a go-to approach to parallelize SGD over a shared-memory setting. Despite its popularity and concomitant extensions,…
cs.LG2020
Stochastic Gradient Langevin with Delayed Gradients
Vyacheslav Kungurtsev, Bapi Chatterjee, Dan Alistarh
Stochastic Gradient Langevin Dynamics (SGLD) ensures strong guarantees with regards to convergence in measure for sampling log-concave posterior distributions by adding noise to st…
cs.LG2020
Elastic Consistency: A General Consistency Model for Distributed Stochastic Gradient Descent
Giorgi Nadiradze, Ilia Markov, Bapi Chatterjee +2
Machine learning has made tremendous progress in recent years, with models matching or even surpassing humans on a series of specialized tasks. One key element behind the progress…