718 citations · 854 across the 22 of their papers we have counts for
23 papers
Parameter-Efficient Tuning Large Language Models for Graph Representation Learning
Qi Zhu, Da Zheng, Xiang Song +4
Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) hav…
Tango: rethinking quantization for graph neural network training on GPUs
Shiyang Chen, Da Zheng, Caiwen Ding +3
Graph Neural Networks (GNNs) are becoming increasingly popular due to their superior performance in critical graph-related tasks. While quantization is widely used to accelerate GN…
DistTGL: Distributed Memory-Based Temporal Graph Neural Network Training
Hongkuan Zhou, Da Zheng, Xiang Song +2
Memory-based Temporal Graph Neural Networks are powerful tools in dynamic graph representation learning and have demonstrated superior performance in many real-world applications.…
Graph-Aware Language Model Pre-Training on a Large Graph Corpus Can Help Multiple Graph Applications
Han Xie, Da Zheng, Jun Ma +9
Model pre-training on large text corpora has been demonstrated effective for various downstream applications in the NLP domain. In the graph mining domain, a similar analogy can be…
Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs
Costas Mavromatis, Vassilis N. Ioannidis, Shen Wang +6
How can we learn effective node representations on textual graphs? Graph Neural Networks (GNNs) that use Language Models (LMs) to encode textual information of graphs achieve state…
PaGE-Link: Path-based Graph Neural Network Explanation for Heterogeneous Link Prediction
Shichang Zhang, Jiani Zhang, Xiang Song +4
Transparency and accountability have become major concerns for black-box machine learning (ML) models. Proper explanations for the model behavior increase model transparency and he…
OrthoReg: Improving Graph-regularized MLPs via Orthogonality Regularization
Hengrui Zhang, Shen Wang, Vassilis N. Ioannidis +7
Graph Neural Networks (GNNs) are currently dominating in modeling graph-structure data, while their high reliance on graph structure for inference significantly impedes them from w…
Hector: An Efficient Programming and Compilation Framework for Implementing Relational Graph Neural Networks in GPU Architectures
Kun Wu, Mert Hidayetoğlu, Xiang Song +4
Relational graph neural networks (RGNNs) are graph neural networks with dedicated structures for modeling the different types of nodes and edges in heterogeneous graphs. While RGNN…
From Local to Global: Spectral-Inspired Graph Neural Networks
Ningyuan Huang, Soledad Villar, Carey E. Priebe +4
Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a…
Efficient and effective training of language and graph neural network models
Vassilis N. Ioannidis, Xiang Song, Da Zheng +6
Can we combine heterogenous graph structure with text to learn high-quality semantic and behavioural representations? Graph neural networks (GNN)s encode numerical node attributes…
Nimble GNN Embedding with Tensor-Train Decomposition
Chunxing Yin, Da Zheng, Israt Nisa +3
This paper describes a new method for representing embedding tables of graph neural networks (GNNs) more compactly via tensor-train (TT) decomposition. We consider the scenario whe…
TGL: A General Framework for Temporal GNN Training on Billion-Scale Graphs
Hongkuan Zhou, Da Zheng, Israt Nisa +3
Many real world graphs contain time domain information. Temporal Graph Neural Networks capture temporal information as well as structural and contextual information in the generate…
Distributed Hybrid CPU and GPU training for Graph Neural Networks on Billion-Scale Graphs
Da Zheng, Xiang Song, Chengru Yang +2
Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection,…
TraverseNet: Unifying Space and Time in Message Passing for Traffic Forecasting
Zonghan Wu, Da Zheng, Shirui Pan +3
This paper aims to unify spatial dependency and temporal dependency in a non-Euclidean space while capturing the inner spatial-temporal dependencies for traffic data. For spatial-t…
Global Neighbor Sampling for Mixed CPU-GPU Training on Giant Graphs
Jialin Dong, Da Zheng, Lin F. Yang +1
Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and…
Schema-Aware Deep Graph Convolutional Networks for Heterogeneous Graphs
Saurav Manchanda, Da Zheng, George Karypis
Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure informati…
Learning over Families of Sets -- Hypergraph Representation Learning for Higher Order Tasks
Balasubramaniam Srinivasan, Da Zheng, George Karypis
Graph representation learning has made major strides over the past decade. However, in many relational domains, the input data are not suited for simple graph representations as th…
DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphs
Da Zheng, Chao Ma, Minjie Wang +6
Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection,…
FeatGraph: A Flexible and Efficient Backend for Graph Neural Network Systems
Yuwei Hu, Zihao Ye, Minjie Wang +6
Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is a…
Few-shot link prediction via graph neural networks for Covid-19 drug-repurposing
Vassilis N. Ioannidis, Da Zheng, George Karypis
Predicting interactions among heterogenous graph structured data has numerous applications such as knowledge graph completion, recommendation systems and drug discovery. Often time…
PanRep: Graph neural networks for extracting universal node embeddings in heterogeneous graphs
Vassilis N. Ioannidis, Da Zheng, George Karypis
Learning unsupervised node embeddings facilitates several downstream tasks such as node classification and link prediction. A node embedding is universal if it is designed to be us…
DGL-KE: Training Knowledge Graph Embeddings at Scale
Da Zheng, Xiang Song, Chao Ma +6
Knowledge graphs have emerged as a key abstraction for organizing information in diverse domains and their embeddings are increasingly used to harness their information in various…
Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks
Minjie Wang, Da Zheng, Zihao Ye +12
Advancing research in the emerging field of deep graph learning requires new tools to support tensor computation over graphs. In this paper, we present the design principles and im…