Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach

Zhihua Duan, Jialin Wang

Integrating the structural inductive biases of Graph Neural Networks (GNNs) with the global contextual modeling capabilities of Transformers represents a pivotal challenge in graph…