18 citations · 29 across the 8 of their papers we have counts for
8 papers
Astro-MoE: Mixture of Experts for Multiband Astronomical Time Series
Martina Cádiz-Leyton, Guillermo Cabrera-Vives, Pavlos Protopapas +2
Multiband astronomical time series exhibit heterogeneous variability patterns, sampling cadences, and signal characteristics across bands. Standard transformers apply shared parame…
Image-Based Multi-Survey Classification of Light Curves with a Pre-Trained Vision Transformer
Daniel Moreno-Cartagena, Guillermo Cabrera-Vives, Alejandra M. Muñoz Arancibia +10
We explore the use of Swin Transformer V2, a pre-trained vision Transformer, for photometric classification in a multi-survey setting by leveraging light curves from the Zwicky Tra…
Leveraging pre-trained vision Transformers for multi-band photometric light curve classification
Daniel Moreno-Cartagena, Pavlos Protopapas, Guillermo Cabrera-Vives +3
This study investigates the potential of a pre-trained vision Transformer (VT) model, specifically the Swin Transformer V2 (SwinV2), to classify photometric light curves without th…
Astromer 2
Cristobal Donoso-Oliva, Ignacio Becker, Pavlos Protopapas +3
Foundational models have emerged as a powerful paradigm in deep learning field, leveraging their capacity to learn robust representations from large-scale datasets and effectively…
Uncertainty estimation for time series classification: Exploring predictive uncertainty in transformer-based models for variable stars
Martina Cádiz-Leyton, Guillermo Cabrera-Vives, Pavlos Protopapas +3
Classifying variable stars is key for understanding stellar evolution and galactic dynamics. With the demands of large astronomical surveys, machine learning models, especially att…
Transformer-Based Astronomical Time Series Model with Uncertainty Estimation for Detecting Misclassified Instances
Martina Cádiz-Leyton, Guillermo Cabrera-Vives, Pavlos Protopapas +2
In this work, we present a framework for estimating and evaluating uncertainty in deep-attention-based classifiers for light curves for variable stars. We implemented three techniq…
ATAT: Astronomical Transformer for time series And Tabular data
G. Cabrera-Vives, D. Moreno-Cartagena, N. Astorga +14
The advent of next-generation survey instruments, such as the Vera C. Rubin Observatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time…
Positional Encodings for Light Curve Transformers: Playing with Positions and Attention
Daniel Moreno-Cartagena, Guillermo Cabrera-Vives, Pavlos Protopapas +3
We conducted empirical experiments to assess the transferability of a light curve transformer to datasets with different cadences and magnitude distributions using various position…