Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Relation Geometry in Semantic Space of Language Models
Zhihan Cao, Hiroaki Yamada, Simone Teufel +4
When it comes to generating vector representations of words, current language models are achieving high-quality results. However, what is not known is the extent to which knowledge…
cs.CL2026
Sycophancy Hides Linearly in the Attention Heads
Rifo Genadi, Munachiso Nwadike, Nurdaulet Mukhituly +3
We find that correct-to-incorrect sycophancy signals are most linearly separable within multi-head attention activations. Motivated by the linear representation hypothesis, we trai…