FLARE++: Low-rank attention with dynamic attention routing

Vedant Puri, Yongjie Jessica Zhang, Levent Burak Kara

Full self-attention is a strong token mixer for PDE surrogates on irregular domains, but its quadratic cost limits its use on large problems. Latent-space attention methods such as…