activity
20202022
most citedMarIA: Spanish Language Models

32 citations · 69 across the 11 of their papers we have counts for

collaborators
Showing 2021Show all

9 papers · 1 filter

cs.CV2021

The Large Labelled Logo Dataset (L3D): A Multipurpose and Hand-Labelled Continuously Growing Dataset

Asier Gutiérrez-Fandiño, David Pérez-Fernández, Jordi Armengol-Estapé

In this work, we present the Large Labelled Logo Dataset (L3D), a multipurpose, hand-labelled, continuously growing dataset. It is composed of around 770k of color 256x256 RGB imag…

cs.CL2021

FinEAS: Financial Embedding Analysis of Sentiment

Asier Gutiérrez-Fandiño, Miquel Noguer i Alonso, Petter Kolm +1

We introduce a new language representation model in finance called Financial Embedding Analysis of Sentiment (FinEAS). In financial markets, news and investor sentiment are signifi…

cs.CL2021★ 4 cited

Spanish Legalese Language Model and Corpora

Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Aitor Gonzalez-Agirre +1

There are many Language Models for the English language according to its worldwide relevance. However, for the Spanish language, even if it is a widely spoken language, there are v…

cs.CL2021★ 23 cited

Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario

Casimiro Pio Carrino, Jordi Armengol-Estapé, Asier Gutiérrez-Fandiño +4

This work presents biomedical and clinical language models for Spanish by experimenting with different pretraining choices, such as masking at word and subword level, varying the v…

cs.CL2021★ 4 cited

Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models

Casimiro Pio Carrino, Jordi Armengol-Estapé, Ona de Gibert Bonet +4

We introduce CoWeSe (the Corpus Web Salud Español), the largest Spanish biomedical corpus to date, consisting of 4.5GB (about 750M tokens) of clean plain text. CoWeSe is the result…

cs.CL2021★ 32 cited

MarIA: Spanish Language Models

Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies +7

This work presents MarIA, a family of Spanish language models and associated resources made available to the industry and the research community. Currently, MarIA includes RoBERTa-…

cs.LG2021

Persistent Homology Captures the Generalization of Neural Networks Without A Validation Set

Asier Gutiérrez-Fandiño, David Pérez-Fernández, Jordi Armengol-Estapé +1

The training of neural networks is usually monitored with a validation (holdout) set to estimate the generalization of the model. This is done instead of measuring intrinsic proper…

cs.CL2021★ 5 cited

Spanish Biomedical and Clinical Language Embeddings

Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Casimiro Pio Carrino +3

We computed both Word and Sub-word Embeddings using FastText. For Sub-word embeddings we selected Byte Pair Encoding (BPE) algorithm to represent the sub-words. We evaluated the Bi…

cs.LG2021

Characterizing and Measuring the Similarity of Neural Networks with Persistent Homology

David Pérez-Fernández, Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé +1

Characterizing the structural properties of neural networks is crucial yet poorly understood, and there are no well-established similarity measures between networks. In this work,…