TREND: TempoRal Event and Node Dynamics for Graph Representation Learning

Abstract

Temporal graph representation learning has drawn significant attention for the prevalence of temporal graphs in the real world. However, most existing works resort to taking discrete snapshots of the temporal graph, or are not inductive to deal with new nodes, or do not model the exciting effects which is the ability of events to influence the occurrence of another event. In this work, We propose TREND, a novel framework for temporal graph representation learning, driven by TempoRal Event and Node Dynamics and built upon a Hawkes process-based graph neural network (GNN). TREND presents a few major advantages: (1) it is inductive due to its GNN architecture; (2) it captures the exciting effects between events by the adoption of the Hawkes process; (3) as our main novelty, it captures the individual and collective characteristics of events by integrating both event and node dynamics, driving a more precise modeling of the temporal process. Extensive experiments on four real-world datasets demonstrate the effectiveness of our proposed model.

arXiv commentAccepted by WWW2022

References in corpus (17)

• Auto-Encoding Variational Bayes
• A Comprehensive Survey on Graph Neural Networks
• DeepWalk: Online Learning of Social Representations
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• LINE: Large-scale Information Network Embedding
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Simplifying Graph Convolutional Networks
• Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks
• The fundamental advantages of temporal networks
• dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learning
• Attributed Network Embedding for Learning in a Dynamic Environment
• DynGEM: Deep Embedding Method for Dynamic Graphs
• The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process
• Node Embedding over Temporal Graphs
• Nonparametric Link Prediction in Dynamic Networks
• Inductive Representation Learning in Temporal Networks via Causal Anonymous Walks
• Meta-Inductive Node Classification across Graphs

Cited by in corpus (7)

• Self-Supervised Temporal Graph learning with Temporal and Structural Intensity Alignment
• TMac: Temporal Multi-Modal Graph Learning for Acoustic Event Classification
• Graph Sequential Neural ODE Process for Link Prediction on Dynamic and Sparse Graphs
• Deep Temporal Graph Clustering: A Comprehensive Benchmark and Datasets
• A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning
• Unsupervised Social Event Detection via Hybrid Graph Contrastive Learning and Reinforced Incremental Clustering
• Temporal Graph Representation Learning with Adaptive Augmentation Contrastive