48 citations · 141 across the 26 of their papers we have counts for
4 papers · 1 filter
Contractive error feedback for gradient compression
Bingcong Li, Shuai Zheng, Parameswaran Raman +2
On-device memory concerns in distributed deep learning have become severe due to (i) the growth of model size in multi-GPU training, and (ii) the wide adoption of deep neural netwo…
Enhancing Sharpness-Aware Optimization Through Variance Suppression
Bingcong Li, Georgios B. Giannakis
Sharpness-aware minimization (SAM) has well documented merits in enhancing generalization of deep neural networks, even without sizable data augmentation. Embracing the geometry of…
Conic Descent Redux for Memory-Efficient Optimization
Bingcong Li, Georgios B. Giannakis
Conic programming has well-documented merits in a gamut of signal processing and machine learning tasks. This contribution revisits a recently developed first-order conic descent (…
Scalable Bayesian Meta-Learning through Generalized Implicit Gradients
Yilang Zhang, Bingcong Li, Shijian Gao +1
Meta-learning owns unique effectiveness and swiftness in tackling emerging tasks with limited data. Its broad applicability is revealed by viewing it as a bi-level optimization pro…