13 citations · 20 across the 11 of their papers we have counts for
6 papers · 2 filters
Context or Knowledge: How LLMs Attribute Their Own Answers
Kirill Afendulev, Alexey Dontsov, Alla Chepurova +2
Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what determines their source report?…
From Stories to Features: Scaling Concept Vectors for AI Alignment & Interpretability
Dmitry Scherbakov, Oleg Chernikov, Victoria Khamash +5
We study feature vectors: directions in a language model's activation space that correspond to human-interpretable concepts, such as honesty or deception. Existing unsupervised met…
LANTERN: Illuminating Hidden Mathematical Knowledge in Language Models
Pavel Tikhonov, Elena Tutubalina, Ivan Oseledets +2
Language models can now prove theorems, but people still decide which problems to pursue. We ask whether a model's internal representations can help identify promising mathematical…
Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs
Pavel Tikhonov, Anton Korznikov, Matvey Mikhalchuk +6
While Large Language Models (LLMs) rely on highly non-linear components, in this work we demonstrate that they exhibit fundamental linearity: when inputs from distinct text streams…
What Attention Recalls and Recurrence Controls in Hybrid Language Models
Kirill Afendulev, Alexey Dontsov, Elena Tutubalina +1
Hybrid language models combine attention with a fixed-size recurrent state, but the role of each channel remains unclear. We introduce two cache-level interventions. Split-prefill…
Anatomy of Unlearning: The Dual Impact of Fact Salience and Model Fine-Tuning
Anna Borisiuk, Andrey Savchenko, Alexander Panchenko +1
Machine Unlearning (MU) enables Large Language Models (LLMs) to remove unsafe or outdated information. However, existing work assumes that all facts are equally forgettable and lar…