4 papers · 1 filter
Pre-training interventions, ex post facto: Grafting model beliefs across checkpoints
Peter Nutter, Dani Roytburg, Clément Dumas +2
Pre-training interventions are critical to alignment research, since beliefs formed during pre-training shape how a model generalizes from later training. One recently popular tech…
Diff Mining: Logit Differences Reveal Finetuning Objectives
Greg Kocher, Robert West, Clément Dumas +1
Finetuning has become the gold standard for refining existing behaviors and inducing new ones in language models, yet it often remains unclear exactly which behaviors emerge during…
Persona Cartography: Charting Language Model Personality Traits in Weight Space
Luke Baines, Anton Gonzalvez Hawthorne, Mariia Koroliuk +4
Large language models exhibit recurring behavioural patterns -- personas -- that shape generalisation and safety, but we lack reliable tools for decomposing, measuring, and control…
Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainers
Adam Karvonen, James Chua, Clément Dumas +8
Large language model (LLM) activations are notoriously difficult to understand, with most existing techniques using complex, specialized methods for interpreting them. Recent work…