activity
20232025
most citedSafety Alignment Should Be Made More Than Just a Few Tokens Deep

4 citations · 10 across the 12 of their papers we have counts for

collaborators
Showing cs.LGShow all

6 papers · 1 filter

cs.LG2024

Inducing Group Fairness in Prompt-Based Language Model Decisions

James Atwood, Nino Scherrer, Preethi Lahoti +3

Classifiers are used throughout industry to enforce policies, ranging from the detection of toxic content to age-appropriate content filtering. While these classifiers serve import…

cs.LG2023★ 1 cited

Multi-Group Fairness Evaluation via Conditional Value-at-Risk Testing

Lucas Monteiro Paes, Ananda Theertha Suresh, Alex Beutel +2

Machine learning (ML) models used in prediction and classification tasks may display performance disparities across population groups determined by sensitive attributes (e.g., race…

cs.LG2023

Improving Robustness via Tilted Exponential Layer: A Communication-Theoretic Perspective

Bhagyashree Puranik, Ahmad Beirami, Yao Qin +1

State-of-the-art techniques for enhancing robustness of deep networks mostly rely on empirical risk minimization with suitable data augmentation. In this paper, we propose a comple…

cs.LG2023

Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuning

Ananth Balashankar, Xiao Ma, Aradhana Sinha +4

As large language models (LLMs) are widely adopted, new safety issues and policies emerge, to which existing safety classifiers do not generalize well. If we have only observed a f…

cs.LG2023★ 2 cited

Controlled Decoding from Language Models

Sidharth Mudgal, Jong Lee, Harish Ganapathy +10

KL-regularized reinforcement learning (RL) is a popular alignment framework to control the language model responses towards high reward outcomes. We pose a tokenwise RL objective a…

cs.LG2023

Break it, Imitate it, Fix it: Robustness by Generating Human-Like Attacks

Aradhana Sinha, Ananth Balashankar, Ahmad Beirami +3

Real-world natural language processing systems need to be robust to human adversaries. Collecting examples of human adversaries for training is an effective but expensive solution.…