activity
20222026
most citedOn Memorization of Large Language Models in Logical Reasoning

2 citations · 7 across the 31 of their papers we have counts for

collaborators
Showing 2024Show all

16 papers · 1 filter

cs.CR2024

On the Differential Privacy and Interactivity of Privacy Sandbox Reports

Badih Ghazi, Charlie Harrison, Arpana Hosabettu +8

The Privacy Sandbox initiative from Google includes APIs for enabling privacy-preserving advertising functionalities as part of the effort around limiting third-party cookies. In p…

cs.LG2024

Balls-and-Bins Sampling for DP-SGD

Lynn Chua, Badih Ghazi, Charlie Harrison +6

We introduce the Balls-and-Bins sampling for differentially private (DP) optimization methods such as DP-SGD. While it has been common practice to use some form of shuffling in DP-…

cs.CY2024

How Unique is Whose Web Browser? The role of demographics in browser fingerprinting among US users

Alex Berke, Enrico Bacis, Badih Ghazi +5

Browser fingerprinting can be used to identify and track users across the Web, even without cookies, by collecting attributes from users' devices to create unique "fingerprints". T…

cs.LG2024

Scalable DP-SGD: Shuffling vs. Poisson Subsampling

Lynn Chua, Badih Ghazi, Pritish Kamath +4

We provide new lower bounds on the privacy guarantee of the multi-epoch Adaptive Batch Linear Queries (ABLQ) mechanism with shuffled batch sampling, demonstrating substantial gaps…

cs.CR2024

Differential Privacy on Trust Graphs

Badih Ghazi, Ravi Kumar, Pasin Manurangsi +1

We study differential privacy (DP) in a multi-party setting where each party only trusts a (known) subset of the other parties with its data. Specifically, given a trust graph wher…

cs.CR2024

Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracy

Yangsibo Huang, Daogao Liu, Lynn Chua +7

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expos…

cs.CL2024★ 2 cited

On Memorization of Large Language Models in Logical Reasoning

Chulin Xie, Yangsibo Huang, Chiyuan Zhang +6

Large language models (LLMs) achieve good performance on challenging reasoning benchmarks, yet could also make basic reasoning mistakes. This contrasting behavior is puzzling when…

cs.LG2024

On Convex Optimization with Semi-Sensitive Features

Badih Ghazi, Pritish Kamath, Ravi Kumar +3

We study the differentially private (DP) empirical risk minimization (ERM) problem under the semi-sensitive DP setting where only some features are sensitive. This generalizes the…

cs.DS2024

On Computing Pairwise Statistics with Local Differential Privacy

Badih Ghazi, Pritish Kamath, Ravi Kumar +2

We study the problem of computing pairwise statistics, i.e., ones of the form , where denotes the input to the th user, with…

cs.CL2024★ 2 cited

Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models

Lynn Chua, Badih Ghazi, Yangsibo Huang +6

Large language models (LLMs) are typically multilingual due to pretraining on diverse multilingual corpora. But can these models relate corresponding concepts across languages, i.e…

cs.CL2024

Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning

Lynn Chua, Badih Ghazi, Yangsibo Huang +6

Large language models (LLMs) have emerged as powerful tools for tackling complex tasks across diverse domains, but they also raise privacy concerns when fine-tuned on sensitive dat…

cs.DS2024

Individualized Privacy Accounting via Subsampling with Applications in Combinatorial Optimization

Badih Ghazi, Pritish Kamath, Ravi Kumar +2

In this work, we give a new technique for analyzing individualized privacy accounting via the following simple observation: if an algorithm is one-sided add-DP, then its subsampled…

cs.LG2024

Differentially Private Optimization with Sparse Gradients

Badih Ghazi, Cristóbal Guzmán, Pritish Kamath +2

Motivated by applications of large embedding models, we study differentially private (DP) optimization problems under sparsity of individual gradients. We start with new near-optim…

cs.CR2024

Differentially Private Ad Conversion Measurement

John Delaney, Badih Ghazi, Charlie Harrison +6

In this work, we study ad conversion measurement, a central functionality in digital advertising, where an advertiser seeks to estimate advertiser website (or mobile app) conversio…

cs.LG2024

How Private are DP-SGD Implementations?

Lynn Chua, Badih Ghazi, Pritish Kamath +4

We demonstrate a substantial gap between the privacy guarantees of the Adaptive Batch Linear Queries (ABLQ) mechanism under different types of batch sampling: (i) Shuffling, and (i…

cs.LG2024

Training Differentially Private Ad Prediction Models with Semi-Sensitive Features

Lynn Chua, Qiliang Cui, Badih Ghazi +9

Motivated by problems arising in digital advertising, we introduce the task of training differentially private (DP) machine learning models with semi-sensitive features. In this se…