9 papers
Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs
Hanlin Cai, Kai Li, Houtianfu Wang +4
Federated fine-tuning (FFT) has emerged as a privacy-preserving paradigm for collaboratively adapting large language models (LLMs). Built upon federated learning, FFT enables distr…
Nonlinearity as Rank: Generative Low-Rank Adapter with Radial Basis Functions
Yihao Ouyang, Shiwei Li, Haozhao Wang +6
Low-rank adaptation (LoRA) approximates the update of a pretrained weight matrix using the product of two low-rank matrices. However, standard LoRA follows an explicit-rank paradig…
Unbiased Rectification for Sequential Recommender Systems Under Fake Orders
Qiyu Qin, Yichen Li, Haozhao Wang +3
Fake orders pose increasing threats to sequential recommender systems by misleading recommendation results through artificially manipulated interactions, including click farming, c…
Resource-Constrained Federated Continual Learning: What Does Matter?
Yichen Li, Yuying Wang, Jiahua Dong +4
Federated Continual Learning (FCL) aims to enable sequentially privacy-preserving model training on streams of incoming data that vary in edge devices by preserving previous knowle…
Rehearsal-Free Continual Federated Learning with Synergistic Synaptic Intelligence
Yichen Li, Yuying Wang, Haozhao Wang +3
Continual Federated Learning (CFL) allows distributed devices to collaboratively learn novel concepts from continuously shifting training data while avoiding knowledge forgetting o…
FedRE: Robust and Effective Federated Learning with Privacy Preference
Tianzhe Xiao, Yichen Li, Yu Zhou +6
Despite Federated Learning (FL) employing gradient aggregation at the server for distributed training to prevent the privacy leakage of raw data, private information can still be d…