4 papers
EmbTracker: Traceable Black-box Watermarking for Federated Language Models
Haodong Zhao, Jinming Hu, Yijie Bai +6
Federated Language Model (FedLM) allows a collaborative learning without sharing raw data, yet it introduces a critical vulnerability, as every untrustworthy client may leak the re…
Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMs
Jack Chen, Fazhong Liu, Naruto Liu +7
Large language models (LLMs) excel at mathematical reasoning and logical problem-solving. The current popular training paradigms primarily use supervised fine-tuning (SFT) and rein…
Depth Gives a False Sense of Privacy: LLM Internal States Inversion
Tian Dong, Yan Meng, Shaofeng Li +3
Large Language Models (LLMs) are increasingly integrated into daily routines, yet they raise significant privacy and safety concerns. Recent research proposes collaborative inferen…
Model Inversion in Split Learning for Personalized LLMs: New Insights from Information Bottleneck Theory
Yunmeng Shu, Shaofeng Li, Tian Dong +2
Personalized Large Language Models (LLMs) have become increasingly prevalent, showcasing the impressive capabilities of models like GPT-4. This trend has also catalyzed extensive r…