LLM Features Can Hurt GNNs: Concatenation Interference on Homophilous Graph Benchmarks

Zhongyuan Wang, Pratyusha Vemuri

Adding LLM-generated node features to graph neural networks (GNNs) is widely reported to improve accuracy on standard benchmarks. We document a contrasting observation: when LLM fe…