4 papers
SecP-Tuning: Efficient Privacy-Preserving Prompt Tuning for Large Language Models via MPC
Jinglong Luo, Zhuo Zhang, Yehong Zhang +6
Large Language Models (LLMs) have revolutionized numerous fields, yet their adaptation to specialized tasks in privacy-sensitive domains such as healthcare and finance remains cons…
Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimization
Dun Zeng, Zheshun Wu, Shiyu Liu +3
Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often fac…
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference
Jinglong Luo, Guanzhong Chen, Yehong Zhang +6
With the growing deployment of pre-trained models like Transformers on cloud platforms, privacy concerns about model parameters and inference data are intensifying. Existing Privac…
On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond
Dun Zeng, Zenglin Xu, Shiyu Liu +3
Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate…