Formalizing and Mitigating Structural Distortion in LLM Attention for Graph Reasoning

Donald Loveland, Puja Trivedi, Ari Weinstein +2

Large Language Models (LLMs) have shown promise for reasoning over Text-Attributed Graphs (TAGs). However, applying LLMs to graphs requires linearizing their structure into sequenc…