5 papers
Tucker Attention: A generalization of approximate attention mechanisms
Timon Klein, Jonas Kusch, Sebastian Sager +2
The pursuit of reducing the memory footprint of the self-attention mechanism in multi-headed self attention (MHA) spawned a rich portfolio of methods, e.g., group-query attention (…
Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization
Thomas Snyder, H. Lexie Yang, Stefan Schnake +1
Deploying geospatial foundation models on resource-constrained edge devices demands compact architectures that maintain high downstream performance. However, their large parameter…
Dynamical Low-Rank Compression of Neural Networks with Robustness under Adversarial Attacks
Steffen Schotthöfer, H. Lexie Yang, Stefan Schnake
Deployment of neural networks on resource-constrained devices demands models that are both compact and robust to adversarial inputs. However, compression and adversarial robustness…
Search for excited tau leptons in the final state in proton-proton collisions at = 13 TeV
CMS Collaboration
Results are presented for a test of the compositeness of the heaviest charged lepton, , using data collected by the CMS experiment in proton-proton collisions at a center-of-ma…
Measurement of the Higgs boson mass and width using the four-lepton final state in proton-proton collisions at = 13 TeV
CMS Collaboration
A measurement of the Higgs boson mass and width via its decay to two Z bosons is presented. Proton-proton collision data collected by the CMS experiment, corresponding to an integr…