Temporal Graph Network Embedding with Causal Anonymous Walks Representations

Abstract

Many tasks in graph machine learning, such as link prediction and node classification, are typically solved by using representation learning, in which each node or edge in the network is encoded via an embedding. Though there exists a lot of network embeddings for static graphs, the task becomes much more complicated when the dynamic (i.e. temporal) network is analyzed. In this paper, we propose a novel approach for dynamic network representation learning based on Temporal Graph Network by using a highly custom message generating function by extracting Causal Anonymous Walks. For evaluation, we provide a benchmark pipeline for the evaluation of temporal network embeddings. This work provides the first comprehensive comparison framework for temporal network representation learning in every available setting for graph machine learning problems involving node classification and link prediction. The proposed model outperforms state-of-the-art baseline models. The work also justifies the difference between them based on evaluation in various transductive/inductive edge/node classification tasks. In addition, we show the applicability and superior performance of our model in the real-world downstream graph machine learning task provided by one of the top European banks, involving credit scoring based on transaction data.

10 pages, 3 figures

References in corpus (15)

• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Prediction
• Graph Transformer Networks
• Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
• Dynamic Graph Convolutional Networks
• DynGEM: Deep Embedding Method for Dynamic Graphs
• Temporal Graph Networks for Deep Learning on Dynamic Graphs
• GC-LSTM: Graph Convolution Embedded LSTM for Dynamic Link Prediction
• Inductive Representation Learning in Temporal Networks via Causal Anonymous Walks
• Structured Sequence Modeling with Graph Convolutional Recurrent Networks
• A3T-GCN: Attention Temporal Graph Convolutional Network for Traffic Forecasting
• Modeling Dynamic Heterogeneous Network for Link Prediction using Hierarchical Attention with Temporal RNN
• On the Equivalence Between Temporal and Static Graph Representations for Observational Predictions
• DyGCN: Dynamic Graph Embedding with Graph Convolutional Network