13 citations · 29 across the 8 of their papers we have counts for
10 papers
How Relevant is Selective Memory Population in Lifelong Language Learning?
Vladimir Araujo, Helena Balabin, Julio Hurtado +2
Lifelong language learning seeks to have models continuously learn multiple tasks in a sequential order without suffering from catastrophic forgetting. State-of-the-art approaches…
Entropy-based Stability-Plasticity for Lifelong Learning
Vladimir Araujo, Julio Hurtado, Alvaro Soto +1
The ability to continuously learn remains elusive for deep learning models. Unlike humans, models cannot accumulate knowledge in their weights when learning new tasks, mainly due t…
Evaluation Benchmarks for Spanish Sentence Representations
Vladimir Araujo, Andrés Carvallo, Souvik Kundu +6
Due to the success of pre-trained language models, versions of languages other than English have been released in recent years. This fact implies the need for resources to evaluate…
DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference
Cristóbal Eyzaguirre, Felipe del Río, Vladimir Araujo +1
Large-scale pre-trained language models have shown remarkable results in diverse NLP applications. Unfortunately, these performance gains have been accompanied by a significant inc…
Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations
Vladimir Araujo, Andrés Villa, Marcelo Mendoza +2
Current language models are usually trained using a self-supervised scheme, where the main focus is learning representations at the word or sentence level. However, there has been…
Stress Test Evaluation of Biomedical Word Embeddings
Vladimir Araujo, Andrés Carvallo, Carlos Aspillaga +2
The success of pretrained word embeddings has motivated their use in the biomedical domain, with contextualized embeddings yielding remarkable results in several biomedical NLP tas…