2 citations · 3 across the 3 of their papers we have counts for
4 papers
σ-GPTs: A New Approach to Autoregressive Models
Arnaud Pannatier, Evann Courdier, François Fleuret
Autoregressive models, such as the GPT family, use a fixed order, usually left-to-right, to generate sequences. However, this is not a necessity. In this paper, we challenge this a…
Inference from Real-World Sparse Measurements
Arnaud Pannatier, Kyle Matoba, François Fleuret
Real-world problems often involve complex and unstructured sets of measurements, which occur when sensors are sparsely placed in either space or time. Being able to model this irre…
HyperMixer: An MLP-based Low Cost Alternative to Transformers
Florian Mai, Arnaud Pannatier, Fabio Fehr +4
Transformer-based architectures are the model of choice for natural language understanding, but they come at a significant cost, as they have quadratic complexity in the input leng…
Efficient Wind Speed Nowcasting with GPU-Accelerated Nearest Neighbors Algorithm
Arnaud Pannatier, Ricardo Picatoste, François Fleuret
This paper proposes a simple yet efficient high-altitude wind nowcasting pipeline. It processes efficiently a vast amount of live data recorded by airplanes over the whole airspace…