43 citations · 281 across the 73 of their papers we have counts for
3 papers · 1 filter
Don't Lose Focus: Activation Steering via Key-Orthogonal Projections
Haoyan Luo, Mateo Espinosa Zarlenga, Mateja Jamnik
Activation steering controls LLM behaviour towards target behaviour by intervening in internal representations, yet it often degrades reasoning and retrieval performance. We argue…
Multilingual Mathematical Autoformalization
Albert Q. Jiang, Wenda Li, Mateja Jamnik
Autoformalization is the task of translating natural language materials into machine-verifiable formalisations. Progress in autoformalization research is hindered by the lack of a…
Structural Inductive Biases in Emergent Communication
Agnieszka Słowik, Abhinav Gupta, William L. Hamilton +3
In order to communicate, humans flatten a complex representation of ideas and their attributes into a single word or a sentence. We investigate the impact of representation learnin…