13 citations · 26 across the 9 of their papers we have counts for
4 papers · 1 filter
Adaptive Communication Bounds for Distributed Online Learning
Michael Kamp, Mario Boley, Michael Mock +3
We consider distributed online learning protocols that control the exchange of information between local learners in a round-based learning scenario. The learning performance of su…
Gap Aware Mitigation of Gradient Staleness
Saar Barkai, Ido Hakimi, Assaf Schuster
Cloud computing is becoming increasingly popular as a platform for distributed training of deep neural networks. Synchronous stochastic gradient descent (SSGD) suffers from substan…
Taming Momentum in a Distributed Asynchronous Environment
Ido Hakimi, Saar Barkai, Moshe Gabel +1
Although distributed computing can significantly reduce the training time of deep neural networks, scaling the training process while maintaining high efficiency and final accuracy…
Efficient Multi-Resource, Multi-Unit VCG Auction
Liran Funaro, Orna Agmon Ben-Yehuda, Assaf Schuster
We consider the optimization problem of a multi-resource, multi-unit VCG auction that produces an optimal, i.e., non-approximated, social welfare. We present an algorithm that solv…