3 papers
cs.LG2026
Tucker Attention: A generalization of approximate attention mechanisms
Timon Klein, Jonas Kusch, Sebastian Sager +2
The pursuit of reducing the memory footprint of the self-attention mechanism in multi-headed self attention (MHA) spawned a rich portfolio of methods, e.g., group-query attention (…
cs.CV2026
Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization
Thomas Snyder, H. Lexie Yang, Stefan Schnake +1
Deploying geospatial foundation models on resource-constrained edge devices demands compact architectures that maintain high downstream performance. However, their large parameter…
math.NA2025
Data-Driven Filtering of the Spherical Harmonics Method
Benjamin Plumridge, Cory Hauck, Steffen Schotthofer
We investigate a data-driven approach for tuning the filtered spherical harmonics method (\fpn) when solving the radiation transport equation (RTE). The \fpn method extends the cla…