2 papers
cs.CL2026
Emergent Structure in the Marginal Attention Space of Language Models
Valentino Maiorca, Walter Nelson, Francesco Locatello
While representation similarity across independently trained language models is well-documented, how internal mechanics such as attention behave across models remains far less char…
cs.LG2026
Toward Identifiable Sparse Autoencoders
Walter Nelson, Theofanis Karaletsos, Francesco Locatello
Recently, sparse autoencoders (SAEs) have emerged as an attractive tool for interpreting and interacting with representations in practical neural networks. While it is common empir…