26 citations · 39 across the 14 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Degree-based stratification of nodes in Graph Neural Networks
Ameen Ali, Hakan Cevikalp, Lior Wolf
Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Tr…
cs.LG2023
Centered Self-Attention Layers
Ameen Ali, Tomer Galanti, Lior Wolf
The self-attention mechanism in transformers and the message-passing mechanism in graph neural networks are repeatedly applied within deep learning architectures. We show that this…