1 citations · 1 across the 3 of their papers we have counts for
4 papers
Let the Heads Talk: Beyond Diagonal Graph Attention
Riccardo Ali, Alessio Borgi, Mario Severino +4
Sheaf Neural Networks generalize scalar-weighted message passing by replacing scalar edge weights with linear transport maps between local feature spaces. Yet the role of this matr…
Remember to Forget: Gated Adaptive Positional Encoding
Riccardo Ali, Alessio Borgi, Christopher Irwin +2
Rotary Positional Encoding (RoPE) is widely used in modern large language models. However, when sequences are extended beyond the range seen during training, rotary phases can ente…
HealthBranches: Synthesizing Clinically-Grounded Question Answering Datasets via Decision Pathways
Cristian Cosentino, Annamaria Defilippo, Marco Dossena +3
HealthBranches is a novel benchmark dataset for medical Question-Answering (Q&A), specifically designed to evaluate complex reasoning in Large Language Models (LLMs). This dataset…
Entropy-Lens: Uncovering Decision Strategies in LLMs
Riccardo Ali, Francesco Caso, Christopher Irwin +1
In large language models (LLMs), each block operates on the residual stream to map input token sequences to output token distributions. However, most of the interpretability litera…