ConvDySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention and Convolutional Neural Networks
arXiv:2106.11430
Abstract
Learning node representations on temporal graphs is a fundamental step to learn real-word dynamic graphs efficiently. Real-world graphs have the nature of continuously evolving over time, such as changing edges weights, removing and adding nodes and appearing and disappearing of edges, while previous graph representation learning methods focused generally on static graphs. We present ConvDySAT as an enhancement of DySAT, one of the state-of-the-art dynamic methods, by augmenting convolution neural networks with the self-attention mechanism, the employed method in DySAT to express the structural and temporal evolution. We conducted single-step link prediction on a communication network and rating network, Experimental results show significant performance gains for ConvDySAT over various state-of-the-art methods.
References in corpus (9)
- Semi-Supervised Classification with Graph Convolutional Networks
- Inductive Representation Learning on Large Graphs
- An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
- Graph Neural Networks: A Review of Methods and Applications
- Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
- FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling
- QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
- Attributed Network Embedding for Learning in a Dynamic Environment
- Scalable Link Prediction in Dynamic Networks via Non-Negative Matrix Factorization