activity
20192023
most citedFast and Memory Efficient Differentially Private-SGD via JL Projections

8 citations · 20 across the 7 of their papers we have counts for

collaborators

10 papers

cs.LG2023

Zero redundancy distributed learning with differential privacy

Zhiqi Bu, Justin Chiu, Ruixuan Liu +2

Deep learning using large models have achieved great success in a wide range of domains. However, training these models on billions of parameters is very challenging in terms of th…

cs.LG2022

Accelerating Adversarial Perturbation by 50% with Semi-backward Propagation

Zhiqi Bu

Adversarial perturbation plays a significant role in the field of adversarial robustness, which solves a maximization problem over the input data. We show that the backward propaga…

stat.ML2022

Sparse Neural Additive Model: Interpretable Deep Learning with Feature Selection via Group Sparsity

Shiyun Xu, Zhiqi Bu, Pratik Chaudhari +1

Interpretable machine learning has demonstrated impressive performance while preserving explainability. In particular, neural additive models (NAM) offer the interpretability to th…

cs.CR2021

Privacy Amplification via Iteration for Shuffled and Online PNSGD

Matteo Sordello, Zhiqi Bu, Jinshuo Dong

In this paper, we consider the framework of privacy amplification via iteration, which is originally proposed by Feldman et al. and subsequently simplified by Asoodeh et al. in the…

cs.LG20216 cited

Accuracy, Interpretability, and Differential Privacy via Explainable Boosting

Harsha Nori, Rich Caruana, Zhiqi Bu +2

We show that adding differential privacy to Explainable Boosting Machines (EBMs), a recent method for training interpretable ML models, yields state-of-the-art accuracy while prote…

cs.LG20218 cited

Fast and Memory Efficient Differentially Private-SGD via JL Projections

Zhiqi Bu, Sivakanth Gopi, Janardhan Kulkarni +3

Differentially Private-SGD (DP-SGD) of Abadi et al. (2016) and its variations are the only known algorithms for private training of large scale neural networks. This algorithm requ…