8 papers
Neuro-symbolic Syntactic Parsing: Shaping a Neural Network with the CYK Algorithm
Fabio Massimo Zanzotto, Federico Ranaldi, Giorgio Satta
In this paper, we show the possibility of a direct injection of algorithms into neural network architecture. We focus on a complex algorithm, that is, Cocke-Youger-Kasami (CYK) for…
Abstract Activation Spaces for Content-Invariant Reasoning in Large Language Models
Gabriele Maraia, Marco Valentino, Fabio Massimo Zanzotto +1
Large Language Models (LLMs) often struggle with deductive judgment in syllogistic reasoning, systematically conflating semantic plausibility with formal validity a phenomenon know…
Challenging the Abilities of Large Language Models in Italian: a Community Initiative
Malvina Nissim, Danilo Croce, Viviana Patti +78
The rapid progress of Large Language Models (LLMs) has transformed natural language processing and broadened its impact across research and society. Yet, systematic evaluation of t…
ECKO: Explainable Clinical Knowledge for Oncology
Marta Contreiras Silva, Daniel Faria, Laura Balbi +13
Personalized oncology aims to tailor treatment strategies to the unique molecular and clinical profiles of individual patients, moving beyond the traditional paradigm of treating t…
Protoknowledge Shapes Behaviour of LLMs in Downstream Tasks: Memorization and Generalization with Knowledge Graphs
Federico Ranaldi, Andrea Zugarini, Leonardo Ranaldi +1
We introduce the concept of protoknowledge to formalize and measure how sequences of tokens encoding Knowledge Graphs are internalized during pretraining and utilized at inference…
Improving Multilingual Retrieval-Augmented Language Models through Dialectic Reasoning Argumentations
Leonardo Ranaldi, Federico Ranaldi, Fabio Massimo Zanzotto +2
Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges,…