9 citations · 15 across the 15 of their papers we have counts for
4 papers · 1 filter
Improving Activation Steering in Language Models with Mean-Centring
Ole Jorgensen, Dylan Cope, Nandi Schoots +1
Recent work in activation steering has demonstrated the potential to better control the outputs of Large Language Models (LLMs), but it involves finding steering vectors. This is d…
Comparing Optimization Targets for Contrast-Consistent Search
Hugo Fry, Seamus Fallows, Ian Fan +2
We investigate the optimization target of Contrast-Consistent Search (CCS), which aims to recover the internal representations of truth of a large language model. We present a new…
Any Deep ReLU Network is Shallow
Mattia Jacopo Villani, Nandi Schoots
We constructively prove that every deep ReLU network can be rewritten as a functionally identical three-layer network with weights valued in the extended reals. Based on this proof…
Low-Entropy Latent Variables Hurt Out-of-Distribution Performance
Nandi Schoots, Dylan Cope
We study the relationship between the entropy of intermediate representations and a model's robustness to distributional shift. We train models consisting of two feed-forward netwo…