108 citations · 234 across the 12 of their papers we have counts for
14 papers
Can AI Forecast the Extremes? Evaluating Probabilistic Weather Models on Tropical Cyclones
Nathan Chalumeau, Xavier Renard, Remi Meynadier +3
Weather prediction is undergoing an important shift, with data-driven AI models outperforming leading numerical weather prediction systems on average at a fraction of the computati…
Poseidon: Efficient Foundation Models for PDEs
Maximilian Herde, Bogdan Raonić, Tobias Rohner +4
We introduce Poseidon, a foundation model for learning the solution operators of PDEs. It is based on a multiscale operator transformer, with time-conditioned layer norms that enab…
Module-wise Training of Neural Networks via the Minimizing Movement Scheme
Skander Karkar, Ibrahim Ayed, Emmanuel de Bézenac +1
Greedy layer-wise or module-wise training of neural networks is compelling in constrained and on-device settings where memory is limited, as it circumvents a number of problems of…
An operator preconditioning perspective on training in physics-informed machine learning
Tim De Ryck, Florent Bonnet, Siddhartha Mishra +1
In this paper, we investigate the behavior of gradient descent algorithms in physics-informed machine learning methods like PINNs, which minimize residuals connected to partial dif…
Representation Equivalent Neural Operators: a Framework for Alias-free Operator Learning
Francesca Bartolucci, Emmanuel de Bézenac, Bogdan Raonić +3
Recently, operator learning, or learning mappings between infinite-dimensional function spaces, has garnered significant attention, notably in relation to learning partial differen…
Unifying GANs and Score-Based Diffusion as Generative Particle Models
Jean-Yves Franceschi, Mike Gartrell, Ludovic Dos Santos +4
Particle-based deep generative models, such as gradient flows and score-based diffusion models, have recently gained traction thanks to their striking performance. Their principle…
Convolutional Neural Operators for robust and accurate learning of PDEs
Bogdan Raonić, Roberto Molinaro, Tim De Ryck +5
Although very successfully used in conventional machine learning, convolution based neural network architectures -- believed to be inconsistent in function space -- have been large…
Block-wise Training of Residual Networks via the Minimizing Movement Scheme
Skander Karkar, Ibrahim Ayed, Emmanuel de Bézenac +1
End-to-end backpropagation has a few shortcomings: it requires loading the entire model during training, which can be impossible in constrained settings, and suffers from three loc…
Mapping conditional distributions for domain adaptation under generalized target shift
Matthieu Kirchmeyer, Alain Rakotomamonjy, Emmanuel de Bezenac +1
We consider the problem of unsupervised domain adaptation (UDA) between a source and a target domain under conditional and label shift a.k.a Generalized Target Shift (GeTarS). Unli…
A Neural Tangent Kernel Perspective of GANs
Jean-Yves Franceschi, Emmanuel de Bézenac, Ibrahim Ayed +3
We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GA…
LEADS: Learning Dynamical Systems that Generalize Across Environments
Yuan Yin, Ibrahim Ayed, Emmanuel de Bézenac +2
When modeling dynamical systems from real-world data samples, the distribution of data often changes according to the environment in which they are captured, and the dynamics of th…
Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting
Yuan Yin, Vincent Le Guen, Jérémie Dona +4
Forecasting complex dynamical phenomena in settings where only partial knowledge of their dynamics is available is a prevalent problem across various scientific fields. While purel…
A Principle of Least Action for the Training of Neural Networks
Skander Karkar, Ibrahim Ayed, Emmanuel de Bézenac +1
Neural networks have been achieving high generalization performance on many tasks despite being highly over-parameterized. Since classical statistical learning theory struggles to…
Learning Dynamical Systems from Partial Observations
Ibrahim Ayed, Emmanuel de Bézenac, Arthur Pajot +2
We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural dat…