10 papers
Preserving Node-level Privacy in Graph Neural Networks
Zihang Xiang, Tianhao Wang, Di Wang
Differential privacy (DP) has seen immense applications in learning on tabular, image, and sequential data where instance-level privacy is concerned. In learning on graphs, contras…
Tight Privacy Audit in One Run
Zihang Xiang, Tianhao Wang, Hanshen Xiao +2
In this paper, we study the problem of privacy audit in one run and show that our method achieves tight audit results for various differentially private protocols. This includes ob…
Beyond Ordinary Lipschitz Constraints: Differentially Private Stochastic Optimization with Tsybakov Noise Condition
Difei Xu, Meng Ding, Zihang Xiang +2
We study Stochastic Convex Optimization in the Differential Privacy model (DP-SCO). Unlike previous studies, here we assume the population risk function satisfies the Tsybakov Nois…
Revisiting Differentially Private Hyper-parameter Tuning
Zihang Xiang, Tianhao Wang, Chenglong Wang +1
We study the application of differential privacy in hyper-parameter tuning, a crucial process in machine learning involving selecting the best hyper-parameter from several candidat…
FlashDP: Private Training Large Language Models with Efficient DP-SGD
Liangyu Wang, Junxiao Wang, Jie Ren +3
As large language models (LLMs) increasingly underpin technological advancements, the privacy of their training data emerges as a critical concern. Differential Privacy (DP) serves…
Differentially Private Sparse Linear Regression with Heavy-tailed Responses
Xizhi Tian, Meng Ding, Touming Tao +2
As a fundamental problem in machine learning and differential privacy (DP), DP linear regression has been extensively studied. However, most existing methods focus primarily on eit…