A Generalization of Transformer Networks to Graphs

Vijay Prakash Dwivedi, Xavier Bresson

We propose a generalization of transformer neural network architecture for arbitrary graphs. The original transformer was designed for Natural Language Processing (NLP), which oper…