19 citations · 64 across the 31 of their papers we have counts for
4 papers · 2 filters
User-friendly Foundation Model Adapters for Multivariate Time Series Classification
Vasilii Feofanov, Romain Ilbert, Malik Tiomoko +2
Foundation models, while highly effective, are often resource-intensive, requiring substantial inference time and memory. This paper addresses the challenge of making these models…
Can LLMs predict the convergence of Stochastic Gradient Descent?
Oussama Zekri, Abdelhakim Benechehab, Ievgen Redko
Large-language models are notoriously famous for their impressive performance across a wide range of tasks. One surprising example of such impressive performance is a recently iden…
SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attention
Romain Ilbert, Ambroise Odonnat, Vasilii Feofanov +4
Transformer-based architectures achieved breakthrough performance in natural language processing and computer vision, yet they remain inferior to simpler linear baselines in multiv…
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift
Renchunzi Xie, Ambroise Odonnat, Vasilii Feofanov +3
Estimating the test performance of a model, possibly under distribution shift, without having access to the ground-truth labels is a challenging, yet very important problem for the…