17 citations · 40 across the 6 of their papers we have counts for
3 papers · 1 filter
Does equivariance matter at scale?
Johann Brehmer, Sönke Behrends, Pim de Haan +1
Given large datasets and sufficient compute, is it beneficial to design neural architectures for the structure and symmetries of each problem? Or is it more efficient to learn them…
FoMo Rewards: Can we cast foundation models as reward functions?
Ekdeep Singh Lubana, Johann Brehmer, Pim de Haan +1
We explore the viability of casting foundation models as generic reward functions for reinforcement learning. To this end, we propose a simple pipeline that interfaces an off-the-s…
Euclidean, Projective, Conformal: Choosing a Geometric Algebra for Equivariant Transformers
Pim de Haan, Taco Cohen, Johann Brehmer
The Geometric Algebra Transformer (GATr) is a versatile architecture for geometric deep learning based on projective geometric algebra. We generalize this architecture into a bluep…