7 citations · 14 across the 7 of their papers we have counts for
3 papers · 1 filter
Steering Language Models With Activation Engineering
Alexander Matt Turner, Lisa Thiergart, Gavin Leech +4
Prompt engineering and finetuning aim to maximize language model performance on a given metric (like toxicity reduction). However, these methods do not fully elicit a model's capab…
Massively Parallel Reweighted Wake-Sleep
Thomas Heap, Gavin Leech, Laurence Aitchison
Reweighted wake-sleep (RWS) is a machine learning method for performing Bayesian inference in a very general class of models. RWS draws samples from an underlying approximate p…
Decision trees compensate for model misspecification
Hugh Panton, Gavin Leech, Laurence Aitchison
The best-performing models in ML are not interpretable. If we can explain why they outperform, we may be able to replicate these mechanisms and obtain both interpretability and per…