5 papers
Graph Machine Learning in the Era of Large Language Models (LLMs)
Shijie Wang, Jiani Huang, Zhikai Chen +8
Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep lear…
Cross-Domain Graph Data Scaling: A Showcase with Diffusion Models
Wenzhuo Tang, Haitao Mao, Danial Dervovic +4
Models for natural language and images benefit from data scaling behavior: the more data fed into the model, the better they perform. This 'better with more' phenomenon enables the…
One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphs
Jingzhe Liu, Haitao Mao, Zhikai Chen +6
Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require caref…
A Survey to Recent Progress Towards Understanding In-Context Learning
Haitao Mao, Guangliang Liu, Yao Ma +3
In-Context Learning (ICL) empowers Large Language Models (LLMs) with the ability to learn from a few examples provided in the prompt, enabling downstream generalization without the…
Towards Neural Scaling Laws on Graphs
Jingzhe Liu, Haitao Mao, Zhikai Chen +3
Deep graph models (e.g., graph neural networks and graph transformers) have become important techniques for leveraging knowledge across various types of graphs. Yet, the neural sca…