1 citations · 1 across the 4 of their papers we have counts for
4 papers
Modular Pretraining Enables Access Control
Ethan Roland, Murat Cubuktepe, Erick Martinez +8
AI developers face a dual-use dilemma. An AI capability that helps one user cure a disease can help another synthesize one. This dilemma could be resolved with access control, limi…
Learning Self-Interpretation from Interpretability Artifacts: Training Lightweight Adapters on Vector-Label Pairs
Keenan Pepper, Alex McKenzie, Florin Pop +6
Self-interpretation methods prompt language models to describe their own internal states, but remain unreliable due to hyperparameter sensitivity. We show that training lightweight…
Endogenous Resistance to Activation Steering in Language Models
Alex McKenzie, Keenan Pepper, Stijn Servaes +6
Large language models can recover mid-generation from task-misaligned activation steering, producing explicit verbal restarts (e.g., ``wait, that's not right'') and continuing on-t…
Self-Ablating Transformers: More Interpretability, Less Sparsity
Jeremias Ferrao, Luhan Mikaelson, Keenan Pepper +1
A growing intuition in machine learning suggests a link between sparsity and interpretability. We introduce a novel self-ablation mechanism to investigate this connection ante-hoc…