11 citations · 46 across the 24 of their papers we have counts for
3 papers · 1 filter
Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning
Bokun Wang, Zhuoning Yuan, Yiming Ying +1
In recent years, model-agnostic meta-learning (MAML) has become a popular research area. However, the stochastic optimization of MAML is still underdeveloped. Existing MAML algorit…
Theoretically Better and Numerically Faster Distributed Optimization with Smoothness-Aware Quantization Techniques
Bokun Wang, Mher Safaryan, Peter Richtárik
To address the high communication costs of distributed machine learning, a large body of work has been devoted in recent years to designing various compression strategies, such as…
IntSGD: Adaptive Floatless Compression of Stochastic Gradients
Konstantin Mishchenko, Bokun Wang, Dmitry Kovalev +1
We propose a family of adaptive integer compression operators for distributed Stochastic Gradient Descent (SGD) that do not communicate a single float. This is achieved by multiply…