3 papers
cs.LG2026
An Analysis of Residual-Stream Geometry Across Transformer Depth
Sunit Bhattacharya, Ravi Shankar Kolli
We propose a transition-centred geometric analysis of transformer residual streams. Relative displacement measures how \emph{far} representations move between consecutive layers, a…
cs.CL2024
Multimodal Shannon Game with Images
Vilém Zouhar, Sunit Bhattacharya, OndÅej Bojar
The Shannon game has long been used as a thought experiment in linguistics and NLP, asking participants to guess the next letter in a sentence based on its preceding context. We ex…
cs.CL2024
Understanding the role of FFNs in driving multilingual behaviour in LLMs
Sunit Bhattacharya, OndÅej Bojar
Multilingualism in Large Language Models (LLMs) is an yet under-explored area. In this paper, we conduct an in-depth analysis of the multilingual capabilities of a family of a Larg…