Dynamic Quadtree Tokenization and Transformer for Adaptive Mesh PDE Forecasting

Yilin Zhuang, Noah Zambrano, Karthik Duraisamy

The quadratic attention cost of Vision Transformers (ViTs) forces a trade-off between spatial resolution and rollout horizon, particularly for fine-scale PDEs where shocks, reactio…