70 citations · 70 across the 2 of their papers we have counts for
3 papers
On the geometry and topology of representations: the manifolds of modular addition
Gabriela Moisescu-Pareja, Gavin McCracken, Harley Wiltzer +4
The Clock and Pizza interpretations, associated with architectures differing in either uniform or learnable attention, were introduced to argue that different architectural designs…
Rethinking Graph Transformers with Spectral Attention
Devin Kreuzer, Dominique Beaini, William L. Hamilton +2
In recent years, the Transformer architecture has proven to be very successful in sequence processing, but its application to other data structures, such as graphs, has remained li…
Directional Graph Networks
Dominique Beaini, Saro Passaro, Vincent Létourneau +3
The lack of anisotropic kernels in graph neural networks (GNNs) strongly limits their expressiveness, contributing to well-known issues such as over-smoothing. To overcome this lim…