high-dimensional manifolds 1language models 1representation learning 1residual stream analysis 1sky map decoding 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.LG2026
Sky sphere representation in language models
Aleksandr Berdnikov, Yevgeny Liokumovich
The paper investigates whether large language models (~100B parameters) contain a decodable representation of the night sky map within their residual streams, showing that most exa…
math.MG2026
Urysohn Width and Surgeries
Aleksandr Berdnikov, Brendan Isley
We analyze the behavior of Urysohn width of manifolds under a connected sum operation, specifically, bounding widths of summands in terms of widths of the sum and vice versa. Our m…