5 citations · 10 across the 8 of their papers we have counts for
9 papers
Cross-Lingual Transferability of Training Data Extraction Attacks to Recover Memorized PII
Alexandru Nazare, Agnese Profico, Nicolò Vania +6
The robustness of Personally Identifiable Information (PII) protection in Large Language Models (LLMs) is a critical concern, yet the risks associated with cross-lingual data extra…
Neuro-symbolic Syntactic Parsing: Shaping a Neural Network with the CYK Algorithm
Fabio Massimo Zanzotto, Federico Ranaldi, Giorgio Satta
In this paper, we show the possibility of a direct injection of algorithms into neural network architecture. We focus on a complex algorithm, that is, Cocke-Youger-Kasami (CYK) for…
Abstract Activation Spaces for Content-Invariant Reasoning in Large Language Models
Gabriele Maraia, Marco Valentino, Fabio Massimo Zanzotto +1
Large Language Models (LLMs) often struggle with deductive judgment in syllogistic reasoning, systematically conflating semantic plausibility with formal validity a phenomenon know…
Protoknowledge Shapes Behaviour of LLMs in Downstream Tasks: Memorization and Generalization with Knowledge Graphs
Federico Ranaldi, Andrea Zugarini, Leonardo Ranaldi +1
We introduce the concept of protoknowledge to formalize and measure how sequences of tokens encoding Knowledge Graphs are internalized during pretraining and utilized at inference…
Animate, or Inanimate, That is the Question for Large Language Models
Leonardo Ranaldi, Giulia Pucci, Fabio Massimo Zanzotto
The cognitive essence of humans is deeply intertwined with the concept of animacy, which plays an essential role in shaping their memory, vision, and multi-layered language underst…
Preserving Privacy in Large Language Models: A Survey on Current Threats and Solutions
Michele Miranda, Elena Sofia Ruzzetti, Andrea Santilli +3
Large Language Models (LLMs) represent a significant advancement in artificial intelligence, finding applications across various domains. However, their reliance on massive interne…
Linguistic Fingerprint in Transformer Models: How Language Variation Influences Parameter Selection in Irony Detection
Michele Mastromattei, Fabio Massimo Zanzotto
This paper explores the correlation between linguistic diversity, sentiment analysis and transformer model architectures. We aim to investigate how different English variations imp…
HANS, are you clever? Clever Hans Effect Analysis of Neural Systems
Leonardo Ranaldi, Fabio Massimo Zanzotto
Instruction-tuned Large Language Models (It-LLMs) have been exhibiting outstanding abilities to reason around cognitive states, intentions, and reactions of all people involved, le…
PreCog: Exploring the Relation between Memorization and Performance in Pre-trained Language Models
Leonardo Ranaldi, Elena Sofia Ruzzetti, Fabio Massimo Zanzotto
Pre-trained Language Models such as BERT are impressive machines with the ability to memorize, possibly generalized learning examples. We present here a small, focused contribution…