activity
20202023
most citedMarIA: Spanish Language Models

32 citations · 51 across the 9 of their papers we have counts for

collaborators

9 papers

cs.PL2023

SLaDe: A Portable Small Language Model Decompiler for Optimized Assembly

Jordi Armengol-Estapé, Jackson Woodruff, Chris Cummins +1

Decompilation is a well-studied area with numerous high-quality tools available. These are frequently used for security tasks and to port legacy code. However, they regularly gener…

cs.PL2023★ 10 cited

Matching Linear Algebra and Tensor Code to Specialized Hardware Accelerators

Pablo Antonio Martínez, Jackson Woodruff, Jordi Armengol-Estapé +3

Dedicated tensor accelerators demonstrate the importance of linear algebra in modern applications. Such accelerators have the potential for impressive performance gains, but requir…

cs.CL2022★ 1 cited

esCorpius: A Massive Spanish Crawling Corpus

Asier Gutiérrez-Fandiño, David Pérez-Fernández, Jordi Armengol-Estapé +2

In the recent years, transformer-based models have lead to significant advances in language modelling for natural language processing. However, they require a vast amount of data t…

cs.CL2021★ 3 cited

Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan

Jordi Armengol-Estapé, Casimiro Pio Carrino, Carlos Rodriguez-Penagos +5

Multilingual language models have been a crucial breakthrough as they considerably reduce the need of data for under-resourced languages. Nevertheless, the superiority of language-…

cs.CL2021★ 32 cited

MarIA: Spanish Language Models

Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies +7

This work presents MarIA, a family of Spanish language models and associated resources made available to the industry and the research community. Currently, MarIA includes RoBERTa-…

cs.LG2021

Persistent Homology Captures the Generalization of Neural Networks Without A Validation Set

Asier Gutiérrez-Fandiño, David Pérez-Fernández, Jordi Armengol-Estapé +1

The training of neural networks is usually monitored with a validation (holdout) set to estimate the generalization of the model. This is done instead of measuring intrinsic proper…

cs.CL2021★ 5 cited

Spanish Biomedical and Clinical Language Embeddings

Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Casimiro Pio Carrino +3

We computed both Word and Sub-word Embeddings using FastText. For Sub-word embeddings we selected Byte Pair Encoding (BPE) algorithm to represent the sub-words. We evaluated the Bi…

cs.LG2021

Characterizing and Measuring the Similarity of Neural Networks with Persistent Homology

David Pérez-Fernández, Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé +1

Characterizing the structural properties of neural networks is crucial yet poorly understood, and there are no well-established similarity measures between networks. In this work,…

cs.CR2020

A Vulnerability Study on Academic Collaboration Networks Based on Network Dynamics

Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marta Villegas

Researchers that work for the same institution use their email as the main communication tool. Email can be one of the most fruitful attack vectors of research institutions as they…