GraphiT: Encoding Graph Structure in Transformers

Grégoire Mialon, Dexiong Chen, Margot Selosse +1

We show that viewing graphs as sets of node features and incorporating structural and positional information into a transformer architecture is able to outperform representations l…