When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains

Brandon Yee, Pairie Koh, Jack Rodriguez +1

We study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures w…