4 papers
Global Communication or Graph-Specific Memory?
Hamed Shirzad, Danica J. Sutherland
Scalable Graph Transformers are commonly trained and evaluated on static large graphs in a transductive setup. Many scalable Graph Transformer components can be formulated as a con…
SeedER: Seed-Expand-Retrieve for Efficient Knowledge Graph Retrieval
Hamed Shirzad, Frederik Wenkel, Dominique Beaini +2
Knowledge graphs (KGs) offer a rich representation for relational knowledge, but their irregular structure makes retrieval challenging: ego-graph expansion grows rapidly, and dense…
Even Sparser Graph Transformers
Hamed Shirzad, Honghao Lin, Balaji Venkatachalam +3
Graph Transformers excel in long-range dependency modeling, but generally require quadratic memory complexity in the number of nodes in an input graph, and hence have trouble scali…
A Theory for Compressibility of Graph Transformers for Transductive Learning
Hamed Shirzad, Honghao Lin, Ameya Velingker +3
Transductive tasks on graphs differ fundamentally from typical supervised machine learning tasks, as the independent and identically distributed (i.i.d.) assumption does not hold a…