Two Facets of the Same Optimization Coin: Model Degradation and Representation Collapse in Graph Foundation Models

Xunkai Li, Daohan Su, Sicheng Liu +5

Inspired by the success of LLMs, GFMs are designed to learn the optimal embedding functions from multi-domain text-attributed graphs for the downstream cross-task generalization ca…