Capacity-Controlled Global Attention for Graph Transformers

Yang Liu, Dongxin Guo, Tom Zheng +3

Global self-attention drives modern graph transformers, yet the softmax at its core imposes a structural constraint rarely examined directly: every attention row is non-negative an…