8 papers
Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods
Lise Le Boudec, Emmanuel de Bezenac, Louis Serrano +3
Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution sp…
Test-time Generalization for Physics through Neural Operator Splitting
Louis Serrano, Jiequn Han, Edouard Oyallon +2
Neural operators have shown promise in learning solution maps of partial differential equations (PDEs), but they often struggle to generalize when test inputs lie outside the train…
JAFAR: Jack up Any Feature at Any Resolution
Paul Couairon, Loick Chambon, Louis Serrano +3
Foundation Vision Encoders have become essential for a wide range of dense vision tasks. However, their low-resolution spatial feature outputs necessitate feature upsampling to pro…
ENMA: Tokenwise Autoregression for Generative Neural PDE Operators
Armand Kassaï Koupaï, Lise Le Boudec, Louis Serrano +1
Solving time-dependent parametric partial differential equations (PDEs) remains a fundamental challenge for neural solvers, particularly when generalizing across a wide range of ph…
AB-UPT for Automotive and Aerospace Applications
Benedikt Alkin, Richard Kurle, Louis Serrano +2
The recently proposed Anchored-Branched Universal Physics Transformers (AB-UPT) shows strong capabilities to replicate automotive computational fluid dynamics simulations requiring…
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training
Adel Nabli, Louis Fournier, Pierre Erbacher +3
Training LLMs relies on distributed implementations using multiple GPUs to compute gradients in parallel with sharded optimizers. However, synchronizing gradients in data parallel…