13 citations · 13 across the 6 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Tucker Attention: A generalization of approximate attention mechanisms
Timon Klein, Jonas Kusch, Sebastian Sager +2
The pursuit of reducing the memory footprint of the self-attention mechanism in multi-headed self attention (MHA) spawned a rich portfolio of methods, e.g., group-query attention (…
cs.CV2026
Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization
Thomas Snyder, H. Lexie Yang, Stefan Schnake +1
Deploying geospatial foundation models on resource-constrained edge devices demands compact architectures that maintain high downstream performance. However, their large parameter…