1 citations · 1 across the 13 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Regularized Top-: A Bayesian Framework for Gradient Sparsification
Ali Bereyhi, Ben Liang, Gary Boudreau +1
Error accumulation is effective for gradient sparsification in distributed settings: initially-unselected gradient entries are eventually selected as their accumulated error exceed…
cs.LG2024
Novel Gradient Sparsification Algorithm via Bayesian Inference
Ali Bereyhi, Ben Liang, Gary Boudreau +1
Error accumulation is an essential component of the Top- sparsification method in distributed gradient descent. It implicitly scales the learning rate and prevents the slow-down…