works on
high-dimensional manifolds 1language models 1representation learning 1residual stream analysis 1sky map decoding 1

From the 1 of 3 linked papers with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Sky sphere representation in language models

Aleksandr Berdnikov, Yevgeny Liokumovich

The paper investigates whether large language models (~100B parameters) contain a decodable representation of the night sky map within their residual streams, showing that most exa…