2 citations · 4 across the 9 of their papers we have counts for
9 papers
PrivacySIM: Evaluating LLM Simulation of User Privacy Behavior
James Flemings, Murali Annavaram
Large language models (LLMs) are increasingly used to simulate human behavior, but their ability to simulate privacy decisions is not well understood. In this paper, w…
Fast NF4 Dequantization Kernels for Large Language Model Inference
Xiangbo Qi, Chaoyi Jiang, Murali Annavaram
Large language models (LLMs) have grown beyond the memory capacity of single GPU devices, necessitating quantization techniques for practical deployment. While NF4 (4-bit NormalFlo…
Personalizing Agent Privacy Decisions via Logical Entailment
James Flemings, Ren Yi, Octavian Suciu +3
Personal large language model (LLM) agents increasingly perform tasks that require access to user data, raising concerns about appropriate data disclosure. We show that relying sol…
Memory-Efficient Differentially Private Training with Gradient Random Projection
Alex Mulrooney, Devansh Gupta, James Flemings +4
Differential privacy (DP) protects sensitive data during neural network training, but standard methods like DP-Adam suffer from high memory overhead due to per-sample gradient clip…
Differentially Private In-context Learning via Sampling Few-shot Mixed with Zero-shot Outputs
James Flemings, Haosheng Gan, Hongyi Li +2
In-context learning (ICL) has shown promising improvement in downstream task adaptation of LLMs by augmenting prompts with relevant input-output examples (demonstrations). However,…
Adaptively Private Next-Token Prediction of Large Language Models
James Flemings, Meisam Razaviyayn, Murali Annavaram
As Large Language Models (LLMs) proliferate, developing privacy safeguards for these models is crucial. One popular safeguard involves training LLMs in a differentially private man…
Estimating Privacy Leakage of Augmented Contextual Knowledge in Language Models
James Flemings, Bo Jiang, Wanrong Zhang +2
Language models (LMs) rely on their parametric knowledge augmented with relevant contextual knowledge for certain tasks, such as question answering. However, the contextual knowled…
Differentially Private Next-Token Prediction of Large Language Models
James Flemings, Meisam Razaviyayn, Murali Annavaram
Ensuring the privacy of Large Language Models (LLMs) is becoming increasingly important. The most widely adopted technique to accomplish this is DP-SGD, which trains a model to gua…
Differentially Private Knowledge Distillation via Synthetic Text Generation
James Flemings, Murali Annavaram
Large Language models (LLMs) are achieving state-of-the-art performance in many different downstream tasks. However, the increasing urgency of data privacy puts pressure on practit…