3 papers
cs.LG2026
RoVE: Rotary Value Embeddings Attention for Relative Position-dependent Value Pathways
Alejandro GarcÃa-Castellanos, Maurice Weiler, Erik J Bekkers
Rotary Position Embeddings (RoPE) make attention scores position-relative but leave the value pathway position-blind: the message sent by a value token is the same regardless of it…
cs.LG2025
Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems
Xuan Zhang, Limei Wang, Jacob Helwig +60
Advances in artificial intelligence (AI) are fueling a new paradigm of discoveries in natural sciences. Today, AI has started to advance natural sciences by improving, accelerating…
cs.LG2025
Equivariant non-linear maps for neural networks on homogeneous spaces
Elias Nyholm, Oscar Carlsson, Maurice Weiler +1
This paper presents a novel framework for non-linear equivariant neural network layers on homogeneous spaces. The seminal work of Cohen et al. on equivariant -CNNs on homogeneou…