activity
20192026
most citedMeasuring memorization in language models via probabilistic extraction

1 citations · 1 across the 10 of their papers we have counts for

collaborators

12 papers

cs.LG2026

CALLIOPE: Private Insights into AI Use, Without Embeddings

Edith Cohen, Vadym Doroshenko, Badih Ghazi +11

We introduce CALLIOPE, a top-down framework for discovering topic hierarchies in large corpora of unstructured data (e.g., LLM conversations), while supporting differential privacy…

cs.DS2026

Online Differentially Private Consistent Clustering

Edith Cohen, Vadym Doroshenko, Badih Ghazi +7

We study differentially private (DP) -means and -median clustering in the online streaming setting. In this model, points arrive sequentially, and at each time step, we need…

cs.LG2026

Extractable Memorization From First Principles

A. Feder Cooper, Marika Swanberg, Jamie Hayes +6

Recent work on extractable memorization in language models suffers from two contrasting validity problems. Some studies overstate extraction, for example, by using sequences too sh…

cs.CR2025

A Unified Framework for Adversary-Aware Differential Privacy Bounds

Marika Swanberg, Meenatchi Sundaram Muthu Selva Annamalai, Jamie Hayes +2

Differential Privacy (DP) bounds the privacy leakage of a mechanism against worst-case membership inference, but the precise tradeoff between complex adversarial models and DP prot…

cs.LG2024

Privacy in Metalearning and Multitask Learning: Modeling and Separations

Maryam Aliakbarpour, Konstantina Bairaktari, Adam Smith +2

Model personalization allows a set of individuals, each facing a different learning task, to train models that are more accurate for each person than those they could develop indiv…

cs.LG2024★ 1 cited

Measuring memorization in language models via probabilistic extraction

Jamie Hayes, Marika Swanberg, Harsh Chaudhari +6

Large language models (LLMs) are susceptible to memorizing training data, raising concerns about the potential extraction of sensitive information at generation time. Discoverable…

cs.LG2024

Auditing Privacy Mechanisms via Label Inference Attacks

Róbert István Busa-Fekete, Travis Dick, Claudio Gentile +3

We propose reconstruction advantage measures to audit label privatization mechanisms. A reconstruction advantage measure quantifies the increase in an attacker's ability to infer t…

cs.CR2024

ATTAXONOMY: Unpacking Differential Privacy Guarantees Against Practical Adversaries

Rachel Cummings, Shlomi Hod, Jayshree Sarathy +1

Differential Privacy (DP) is a mathematical framework that is increasingly deployed to mitigate privacy risks associated with machine learning and statistical analyses. Despite the…

cs.CR2023

DP-SIPS: A simpler, more scalable mechanism for differentially private partition selection

Marika Swanberg, Damien Desfontaines, Samuel Haney

Partition selection, or set union, is an important primitive in differentially private mechanism design: in a database where each user contributes a list of items, the goal is to p…

cs.LG2022

Differentially Private Sampling from Distributions

Sofya Raskhodnikova, Satchit Sivakumar, Adam Smith +1

We initiate an investigation of private sampling from distributions. Given a dataset with independent observations from an unknown distribution , a sampling algorithm must o…

cs.CR2022

Control, Confidentiality, and the Right to be Forgotten

Aloni Cohen, Adam Smith, Marika Swanberg +1

Recent digital rights frameworks give users the right to delete their data from systems that store and process their personal information (e.g., the "right to be forgotten" in the…

cs.CR2019

Improved Differentially Private Analysis of Variance

Marika Swanberg, Ira Globus-Harris, Iris Griffith +3

Hypothesis testing is one of the most common types of data analysis and forms the backbone of scientific research in many disciplines. Analysis of variance (ANOVA) in particular is…