18 citations · 53 across the 10 of their papers we have counts for
3 papers · 1 filter
PreCog: Exploring the Relation between Memorization and Performance in Pre-trained Language Models
Leonardo Ranaldi, Elena Sofia Ruzzetti, Fabio Massimo Zanzotto
Pre-trained Language Models such as BERT are impressive machines with the ability to memorize, possibly generalized learning examples. We present here a small, focused contribution…
A Trip Towards Fairness: Bias and De-Biasing in Large Language Models
Leonardo Ranaldi, Elena Sofia Ruzzetti, Davide Venditti +2
Cheap-to-Build Very Large-Language Models (CtB-LLMs) with affordable training are emerging as the next big revolution in natural language processing and understanding. These CtB-LL…
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages
Elena Sofia Ruzzetti, Federico Ranaldi, Felicia Logozzo +3
The impressive achievements of transformers force NLP researchers to delve into how these models represent the underlying structure of natural language. In this paper, we propose a…