activity
20182024
most citedJailbroken: How Does LLM Safety Training Fail?

71 citations · 115 across the 9 of their papers we have counts for

collaborators

11 papers

cs.CR2024★ 1 cited

Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation

Danny Halawi, Alexander Wei, Eric Wallace +3

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety…

cs.LG2023★ 71 cited

Jailbroken: How Does LLM Safety Training Fail?

Alexander Wei, Nika Haghtalab, Jacob Steinhardt

Large language models trained for safety and harmlessness remain susceptible to adversarial misuse, as evidenced by the prevalence of "jailbreak" attacks on early releases of ChatG…

cs.GT2022

Learning in Stackelberg Games with Non-myopic Agents

Nika Haghtalab, Thodoris Lykouris, Sloan Nietert +1

We study Stackelberg games where a principal repeatedly interacts with a non-myopic long-lived agent, without knowing the agent's payoff function. Although learning in Stackelberg…

cs.LG2022★ 5 cited

TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernels

Yaodong Yu, Alexander Wei, Sai Praneeth Karimireddy +2

State-of-the-art federated learning methods can perform far worse than their centralized counterparts when clients have dissimilar data distributions. For neural networks, even whe…

cs.LG2022★ 8 cited

More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize

Alexander Wei, Wei Hu, Jacob Steinhardt

Of theories for why large-scale machine learning models generalize despite being vastly overparameterized, which of their assumptions are needed to capture the qualitative phenomen…

cs.LG2022★ 4 cited

Predicting Out-of-Distribution Error with the Projection Norm

Yaodong Yu, Zitong Yang, Alexander Wei +2

We propose a metric -- Projection Norm -- to predict a model's performance on out-of-distribution (OOD) data without access to ground truth labels. Projection Norm first uses model…

cs.LG2021

Learning Equilibria in Matching Markets from Bandit Feedback

Meena Jagadeesan, Alexander Wei, Yixin Wang +2

Large-scale, two-sided matching platforms must find market outcomes that align with user preferences while simultaneously learning these preferences from data. Classical notions of…

cs.GT2021★ 7 cited

Designing Approximately Optimal Search on Matching Platforms

Nicole Immorlica, Brendan Lucier, Vahideh Manshadi +1

We study the design of a decentralized two-sided matching market in which agents' search is guided by the platform. There are finitely many agent types, each with (potentially rand…

cs.LG2020★ 19 cited

Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online Algorithms

Alexander Wei, Fred Zhang

We study the problem of improving the performance of online algorithms by incorporating machine-learned predictions. The goal is to design algorithms that are both consistent and r…

cs.DS2020

Better and Simpler Learning-Augmented Online Caching

Alexander Wei

Lykouris and Vassilvitskii (ICML 2018) introduce a model of online caching with machine-learned advice, where each page request additionally comes with a prediction of when that pa…

cs.DS2018

Optimal Las Vegas Approximate Near Neighbors in

Alexander Wei

We show that approximate near neighbor search in high dimensions can be solved in a Las Vegas fashion (i.e., without false negatives) for () while matching th…