32 citations · 112 across the 13 of their papers we have counts for
5 papers · 1 filter
Securing Distributed SGD against Gradient Leakage Threats
Wenqi Wei, Ling Liu, Jingya Zhou +2
This paper presents a holistic approach to gradient leakage resilient distributed Stochastic Gradient Descent (SGD). First, we analyze two types of strategies for privacy-enhanced…
Selecting and Composing Learning Rate Policies for Deep Neural Networks
Yanzhao Wu, Ling Liu
The choice of learning rate (LR) functions and policies has evolved from a simple fixed LR to the decaying LR and the cyclic LR, aiming to improve the accuracy and reduce the train…
Promoting High Diversity Ensemble Learning with EnsembleBench
Yanzhao Wu, Ling Liu, Zhongwei Xie +3
Ensemble learning is gaining renewed interests in recent years. This paper presents EnsembleBench, a holistic framework for evaluating and recommending high diversity and high accu…
Denoising and Verification Cross-Layer Ensemble Against Black-box Adversarial Attacks
Ka-Ho Chow, Wenqi Wei, Yanzhao Wu +1
Deep neural networks (DNNs) have demonstrated impressive performance on many challenging machine learning tasks. However, DNNs are vulnerable to adversarial inputs generated by add…
Demystifying Learning Rate Policies for High Accuracy Training of Deep Neural Networks
Yanzhao Wu, Ling Liu, Juhyun Bae +6
Learning Rate (LR) is an important hyper-parameter to tune for effective training of deep neural networks (DNNs). Even for the baseline of a constant learning rate, it is non-trivi…