4 citations · 4 across the 6 of their papers we have counts for
3 papers · 1 filter
User Perception of Attention Visualizations: Effects on Interpretability Across Evidence-Based Medical Documents
Andrés Carvallo, Denis Parra, Peter Brusilovsky +4
The attention mechanism is a core component of the Transformer architecture. Beyond improving performance, attention has been proposed as a mechanism for explainability via attenti…
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models
Kushal Tatariya, Vladimir Araujo, Thomas Bauwens +1
Pixel-based language models have emerged as a compelling alternative to subword-based language modelling, particularly because they can represent virtually any script. PIXEL, a can…
Sequence-to-Sequence Spanish Pre-trained Language Models
Vladimir Araujo, Maria Mihaela Trusca, Rodrigo Tufiño +1
In recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-o…