1 citations · 1 across the 3 of their papers we have counts for
3 papers · 1 filter
Let the Heads Talk: Beyond Diagonal Graph Attention
Riccardo Ali, Alessio Borgi, Mario Severino +4
Sheaf Neural Networks generalize scalar-weighted message passing by replacing scalar edge weights with linear transport maps between local feature spaces. Yet the role of this matr…
Remember to Forget: Gated Adaptive Positional Encoding
Riccardo Ali, Alessio Borgi, Christopher Irwin +2
Rotary Positional Encoding (RoPE) is widely used in modern large language models. However, when sequences are extended beyond the range seen during training, rotary phases can ente…
Entropy-Lens: Uncovering Decision Strategies in LLMs
Riccardo Ali, Francesco Caso, Christopher Irwin +1
In large language models (LLMs), each block operates on the residual stream to map input token sequences to output token distributions. However, most of the interpretability litera…