activity
20192023
most citedUnderstanding Gradient Clipping in Private SGD: A Geometric Perspective

60 citations · 160 across the 10 of their papers we have counts for

collaborators

10 papers

cs.LG2023

Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis

Xiang Chen, Zhao Song, Baocheng Sun +2

Many machine learning algorithms require large numbers of labeled data to deliver state-of-the-art results. In applications such as medical diagnosis and fraud detection, though th…

cs.LG2022★ 5 cited

Distributed Adversarial Training to Robustify Deep Neural Networks at Scale

Gaoyuan Zhang, Songtao Lu, Yihua Zhang +7

Current deep neural networks (DNNs) are vulnerable to adversarial attacks, where adversarial perturbations to the inputs can change or manipulate classification. To defend against…

cs.LG2021★ 7 cited

Dynamic Differential-Privacy Preserving SGD

Jian Du, Song Li, Xiangyi Chen +2

The vanilla Differentially-Private Stochastic Gradient Descent (DP-SGD), including DP-Adam and other variants, ensures the privacy of training data by uniformly distributing privac…

cs.LG2021

Toward Communication Efficient Adaptive Gradient Method

Xiangyi Chen, Xiaoyun Li, Ping Li

In recent years, distributed optimization is proven to be an effective approach to accelerate training of large scale machine learning models such as deep neural networks. With the…

cs.LG2021★ 5 cited

On the Convergence of Decentralized Adaptive Gradient Methods

Xiangyi Chen, Belhal Karimi, Weijie Zhao +1

Adaptive gradient methods including Adam, AdaGrad, and their variants have been very successful for training deep learning models, such as neural networks. Meanwhile, given the nee…

cs.LG2021★ 23 cited

Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy

Xinwei Zhang, Xiangyi Chen, Mingyi Hong +2

Providing privacy protection has been one of the primary motivations of Federated Learning (FL). Recently, there has been a line of work on incorporating the formal privacy notion…