1 citations · 1 across the 13 of their papers we have counts for
10 papers · 1 filter
Beyond Ordinary Lipschitz Constraints: Differentially Private Stochastic Optimization with Tsybakov Noise Condition
Difei Xu, Meng Ding, Zihang Xiang +2
We study Stochastic Convex Optimization in the Differential Privacy model (DP-SCO). Unlike previous studies, here we assume the population risk function satisfies the Tsybakov Nois…
FlashDP: Private Training Large Language Models with Efficient DP-SGD
Liangyu Wang, Junxiao Wang, Jie Ren +3
As large language models (LLMs) increasingly underpin technological advancements, the privacy of their training data emerges as a critical concern. Differential Privacy (DP) serves…
Differentially Private Sparse Linear Regression with Heavy-tailed Responses
Xizhi Tian, Meng Ding, Touming Tao +2
As a fundamental problem in machine learning and differential privacy (DP), DP linear regression has been extensively studied. However, most existing methods focus primarily on eit…
Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness
Cheng-Long Wang, Qi Li, Zihang Xiang +2
Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techn…
Improved Rates of Differentially Private Nonconvex-Strongly-Concave Minimax Optimization
Ruijia Zhang, Mingxi Lei, Meng Ding +3
In this paper, we study the problem of (finite sum) minimax optimization in the Differential Privacy (DP) model. Unlike most of the previous studies on the (strongly) convex-concav…
Towards User-level Private Reinforcement Learning with Human Feedback
Jiaming Zhang, Mingxi Lei, Meng Ding +5
Reinforcement Learning with Human Feedback (RLHF) has emerged as an influential technique, enabling the alignment of large language models (LLMs) with human preferences. Despite th…
Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Approximate Unlearning Completeness
Cheng-Long Wang, Qi Li, Zihang Xiang +2
By adopting a more flexible definition of unlearning and adjusting the model distribution to simulate training without the targeted data, approximate machine unlearning provides a…
Revisiting Differentially Private Hyper-parameter Tuning
Zihang Xiang, Tianhao Wang, Chenglong Wang +1
We study the application of differential privacy in hyper-parameter tuning, a crucial process in machine learning involving selecting the best hyper-parameter from several candidat…
Preserving Node-level Privacy in Graph Neural Networks
Zihang Xiang, Tianhao Wang, Di Wang
Differential privacy (DP) has seen immense applications in learning on tabular, image, and sequential data where instance-level privacy is concerned. In learning on graphs, contras…
Differentially Private Non-convex Learning for Multi-layer Neural Networks
Hanpu Shen, Cheng-Long Wang, Zihang Xiang +2
This paper focuses on the problem of Differentially Private Stochastic Optimization for (multi-layer) fully connected neural networks with a single output node. In the first part,…