37 citations · 108 across the 10 of their papers we have counts for
10 papers
Spanish Legalese Language Model and Corpora
Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Aitor Gonzalez-Agirre +1
There are many Language Models for the English language according to its worldwide relevance. However, for the Spanish language, even if it is a widely spoken language, there are v…
Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario
Casimiro Pio Carrino, Jordi Armengol-Estapé, Asier Gutiérrez-Fandiño +4
This work presents biomedical and clinical language models for Spanish by experimenting with different pretraining choices, such as masking at word and subword level, varying the v…
Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models
Casimiro Pio Carrino, Jordi Armengol-Estapé, Ona de Gibert Bonet +4
We introduce CoWeSe (the Corpus Web Salud Español), the largest Spanish biomedical corpus to date, consisting of 4.5GB (about 750M tokens) of clean plain text. CoWeSe is the result…
Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan
Jordi Armengol-Estapé, Casimiro Pio Carrino, Carlos Rodriguez-Penagos +5
Multilingual language models have been a crucial breakthrough as they considerably reduce the need of data for under-resourced languages. Nevertheless, the superiority of language-…
MarIA: Spanish Language Models
Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies +7
This work presents MarIA, a family of Spanish language models and associated resources made available to the industry and the research community. Currently, MarIA includes RoBERTa-…
Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
Anastasios Nentidis, Anastasia Krithara, Konstantinos Bougiatiotis +4
In this paper, we present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020. BioASQ is a…
Persistent Homology Captures the Generalization of Neural Networks Without A Validation Set
Asier Gutiérrez-Fandiño, David Pérez-Fernández, Jordi Armengol-Estapé +1
The training of neural networks is usually monitored with a validation (holdout) set to estimate the generalization of the model. This is done instead of measuring intrinsic proper…
Spanish Biomedical and Clinical Language Embeddings
Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Casimiro Pio Carrino +3
We computed both Word and Sub-word Embeddings using FastText. For Sub-word embeddings we selected Byte Pair Encoding (BPE) algorithm to represent the sub-words. We evaluated the Bi…
Characterizing and Measuring the Similarity of Neural Networks with Persistent Homology
David Pérez-Fernández, Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé +1
Characterizing the structural properties of neural networks is crucial yet poorly understood, and there are no well-established similarity measures between networks. In this work,…
A Vulnerability Study on Academic Collaboration Networks Based on Network Dynamics
Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marta Villegas
Researchers that work for the same institution use their email as the main communication tool. Email can be one of the most fruitful attack vectors of research institutions as they…