activity
20212025
most citedTraining Data Leakage Analysis in Language Models

22 citations · 89 across the 20 of their papers we have counts for

collaborators
Showing 2023Show all

7 papers · 1 filter

cs.CR2023

Sandi: A System for Accountability and Applications in Direct Communication (Extended Abstract)

F. Betül Durak, Kim Laine, Simon Langowski +3

Reputation systems guide our decision making both in life and work: which restaurant to eat at, which vendor to buy from, which software dependencies to use, and who or what to tru…

cs.LG2023★ 1 cited

Privately Aligning Language Models with Reinforcement Learning

Fan Wu, Huseyin A. Inan, Arturs Backurs +3

Positioned between pre-training and user deployment, aligning large language models (LLMs) through reinforcement learning (RL) has emerged as a prevailing strategy for training ins…

cs.LG2023★ 8 cited

Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation

Xinyu Tang, Richard Shin, Huseyin A. Inan +6

We study the problem of in-context learning (ICL) with large language models (LLMs) on private datasets. This scenario poses privacy risks, as LLMs may leak or regurgitate the priv…

cs.LG2023★ 3 cited

Project Florida: Federated Learning Made Easy

Daniel Madrigal Diaz, Andre Manoel, Jialei Chen +2

We present Project Florida, a system architecture and software development kit (SDK) enabling deployment of large-scale Federated Learning (FL) solutions across a heterogeneous dev…

cs.LG2023★ 1 cited

Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings

Yehya Farhat, Hamza ElMokhtar Shili, Fangshuo Liao +7

Mixture-of-Experts (MoEs) achieve scalability by dynamically activating subsets of their components. Yet, understanding how expertise emerges through joint training of gating mecha…

cs.LG2023★ 13 cited

Analyzing Leakage of Personally Identifiable Information in Language Models

Nils Lukas, Ahmed Salem, Robert Sim +3

Language Models (LMs) have been shown to leak information about training data through sentence-level membership inference and reconstruction attacks. Understanding the risk of LMs…