X-LogSMask: Expand Transformer for Graph-Structured Data

Leyan Li, Rennong Yang, Zhenxing Zhang +1

Transformers have become general-purpose architectures, but their all-to-all self-attention is poorly matched to graph data, whose interactions are sparse, structured and multi-sca…