3 papers
cs.NE2024
Learning Graph Quantized Tokenizers
Limei Wang, Kaveh Hassani, Si Zhang +7
Transformers serve as the backbone architectures of Foundational Models, where domain-specific tokenizers allow them to adapt to various domains. Graph Transformers (GTs) have rece…
cs.CL2024
How to Make LMs Strong Node Classifiers?
Zhe Xu, Kaveh Hassani, Si Zhang +7
Language Models (LMs) are increasingly challenging the dominance of domain-specific models, such as Graph Neural Networks (GNNs) and Graph Transformers (GTs), in graph learning tas…
cs.LG2024
A Scalable and Effective Alternative to Graph Transformers
Kaan Sancak, Zhigang Hua, Jin Fang +5
Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited…