1 citations · 1 across the 8 of their papers we have counts for
9 papers
RoVE: Rotary Value Embeddings Attention for Relative Position-dependent Value Pathways
Alejandro García-Castellanos, Maurice Weiler, Erik J Bekkers
Rotary Position Embeddings (RoPE) make attention scores position-relative but leave the value pathway position-blind: the message sent by a value token is the same regardless of it…
Generalized Reduction to the Isotropy for Flexible Equivariant Neural Fields
Alejandro García-Castellanos, Gijs Bellaard, Remco Duits +2
Many geometric learning problems require invariants on heterogeneous product spaces, i.e., products of distinct spaces carrying different group actions, where standard techniques d…
Symmetry-Aware Graph Metanetwork Autoencoders: Model Merging through Parameter Canonicalization
Odysseas Boufalis, Jorge Carrasco-Pollo, Joshua Rosenthal +2
Neural network parameterizations exhibit inherent symmetries that yield multiple equivalent minima within the loss landscape. Scale Graph Metanetworks (ScaleGMNs) explicitly levera…
Symmetry-Aware Fully-Amortized Optimization with Scale Equivariant Graph Metanetworks
Bart Kuipers, Freek Byrman, Daniel Uyterlinde +1
Amortized optimization accelerates the solution of related optimization problems by learning mappings that exploit shared structure across problem instances. We explore the use of…
Randomized HyperSteiner: A Stochastic Delaunay Triangulation Heuristic for the Hyperbolic Steiner Minimal Tree
Aniss Aiman Medbouhi, Alejandro García-Castellanos, Giovanni Luca Marchetti +3
We study the problem of constructing Steiner Minimal Trees (SMTs) in hyperbolic space. Exact SMT computation is NP-hard, and existing hyperbolic heuristics such as HyperSteiner are…
Equivariant Eikonal Neural Networks: Grid-Free, Scalable Travel-Time Prediction on Homogeneous Spaces
Alejandro García-Castellanos, David R. Wessels, Nicky J. van den Berg +3
We introduce Equivariant Neural Eikonal Solvers, a novel framework that integrates Equivariant Neural Fields (ENFs) with Neural Eikonal Solvers. Our approach employs a single neura…