2 citations · 3 across the 6 of their papers we have counts for
3 papers · 1 filter
Platonic Transformers: A Solid Choice For Equivariance
Mohammad Mohaiminul Islam, Rishabh Anand, David R. Wessels +7
While widespread, Transformers lack inductive biases for geometric symmetries common in science and computer vision. Existing equivariant methods often sacrifice the efficiency and…
VDW-GNNs: Vector diffusion wavelets for geometric graph neural networks
David R. Johnson, Alexander Sietsema, Rishabh Anand +3
We introduce vector diffusion wavelets (VDWs), a novel family of wavelets inspired by the vector diffusion maps algorithm that was introduced to analyze data lying in the tangent b…
HELM: Hyperbolic Large Language Models via Mixture-of-Curvature Experts
Neil He, Rishabh Anand, Hiren Madhu +5
Large language models (LLMs) have shown great success in text modeling tasks across domains. However, natural language exhibits inherent semantic hierarchies and nuanced geometric…