5 citations · 6 across the 8 of their papers we have counts for
4 papers · 1 filter
Do Neural Scaling Laws Exist on Graph Self-Supervised Learning?
Qian Ma, Haitao Mao, Jingzhe Liu +5
Self-supervised learning~(SSL) is essential to obtain foundation models in NLP and CV domains via effectively leveraging knowledge in large-scale unlabeled data. The reason for its…
A Pure Transformer Pretraining Framework on Text-attributed Graphs
Yu Song, Haitao Mao, Jiachen Xiao +6
Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progr…
Text-space Graph Foundation Models: Comprehensive Benchmarks and New Insights
Zhikai Chen, Haitao Mao, Jingzhe Liu +8
Given the ubiquity of graph data and its applications in diverse domains, building a Graph Foundation Model (GFM) that can work well across different graphs and tasks with a unifie…
Graph Machine Learning in the Era of Large Language Models (LLMs)
Shijie Wang, Jiani Huang, Zhikai Chen +8
Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep lear…