3 papers · 1 filter
On the locality bias and results in the Long Range Arena
Pablo Miralles-González, Javier Huertas-Tato, Alejandro Martín +1
The Long Range Arena (LRA) benchmark was designed to evaluate the performance of Transformer improvements and alternatives in long-range dependency modeling tasks. The Transformer…
Not all tokens are created equal: Perplexity Attention Weighted Networks for AI generated text detection
Pablo Miralles-González, Javier Huertas-Tato, Alejandro Martín +1
The rapid advancement in large language models (LLMs) has significantly enhanced their ability to generate coherent and contextually relevant text, raising concerns about the misus…
Isolating authorship from content with semantic embeddings and contrastive learning
Javier Huertas-Tato, Adrián Girón-Jiménez, Alejandro Martín +1
Authorship has entangled style and content inside. Authors frequently write about the same topics in the same style, so when different authors write about the exact same topic the…