84 citations · 394 across the 35 of their papers we have counts for
3 papers · 1 filter
Regularizing Transformers With Deep Probabilistic Layers
Aurora Cobo Aguilera, Pablo Martínez Olmos, Antonio Artés-Rodríguez +1
Language models (LM) have grown with non-stop in the last decade, from sequence-to-sequence architectures to the state-of-the-art and utter attention-based Transformers. In this wo…
Deep Autoregressive Models with Spectral Attention
Fernando Moreno-Pino, Pablo M. Olmos, Antonio Artés-Rodríguez
Time series forecasting is an important problem across many domains, playing a crucial role in multiple real-world applications. In this paper, we propose a forecasting architectur…
Medical data wrangling with sequential variational autoencoders
Daniel Barrejón, Pablo M. Olmos, Antonio Artés-Rodríguez
Medical data sets are usually corrupted by noise and missing data. These missing patterns are commonly assumed to be completely random, but in medical scenarios, the reality is tha…