Node Embedding over Temporal Graphs

Abstract

In this work, we present a method for node embedding in temporal graphs. We propose an algorithm that learns the evolution of a temporal graph's nodes and edges over time and incorporates this dynamics in a temporal node embedding framework for different graph prediction tasks. We present a joint loss function that creates a temporal embedding of a node by learning to combine its historical temporal embeddings, such that it optimizes per given task (e.g., link prediction). The algorithm is initialized using static node embeddings, which are then aligned over the representations of a node at different time points, and eventually adapted for the given task in a joint optimization. We evaluate the effectiveness of our approach over a variety of temporal graphs for the two fundamental tasks of temporal link prediction and multi-label node classification, comparing to competitive baselines and algorithmic alternatives. Our algorithm shows performance improvements across many of the datasets and baselines and is found particularly effective for graphs that are less cohesive, with a lower clustering coefficient.

Cited by in corpus (32)

• Temporal Graph Networks for Deep Learning on Dynamic Graphs
• EvoKG: Jointly Modeling Event Time and Network Structure for Reasoning over Temporal Knowledge Graphs
• TREND: TempoRal Event and Node Dynamics for Graph Representation Learning
• Representation Learning for Dynamic Graphs: A Survey
• Inductive Representation Learning in Temporal Networks via Causal Anonymous Walks
• CCGL: Contrastive Cascade Graph Learning
• GloDyNE: Global Topology Preserving Dynamic Network Embedding
• Continual Learning on Dynamic Graphs via Parameter Isolation
• Continuous-Time and Multi-Level Graph Representation Learning for Origin-Destination Demand Prediction
• Recurrent Event Network: Autoregressive Structure Inference over Temporal Knowledge Graphs
• SI-spreading-based network embedding in static and temporal networks
• Geometric Algebra based Embeddings for Static and Temporal Knowledge Graph Completion
• Transition Propagation Graph Neural Networks for Temporal Networks
• Temporal Aggregation and Propagation Graph Neural Networks for Dynamic Representation
• Dynamic Hidden-Variable Network Models
• On the Equivalence Between Temporal and Static Graph Representations for Observational Predictions
• Modeling Dynamic Heterogeneous Network for Link Prediction using Hierarchical Attention with Temporal RNN
• Dynamic Node Embeddings from Edge Streams
• Modeling Event Propagation via Graph Biased Temporal Point Process
• EPNE: Evolutionary Pattern Preserving Network Embedding
• Accelerating Dynamic Network Embedding with Billions of Parameter Updates to Milliseconds
• Heterogeneous-Temporal Graph Convolutional Networks: Make the Community Detection Much Better
• Data-driven Smart Ponzi Scheme Detection
• Robust Training of Temporal GNNs using Nearest Neighbours based Hard Negatives
• ConTIG: Continuous Representation Learning on Temporal Interaction Graphs
• From Static to Dynamic Node Embeddings
• ForeSeer: Product Aspect Forecasting Using Temporal Graph Embedding
• Robust Dynamic Network Embedding via Ensembles
• Competition analysis on the over-the-counter credit default swap market
• TempNodeEmb:Temporal Node Embedding considering temporal edge influence matrix
• Embedding Dynamic Attributed Networks by Modeling the Evolution Processes
• FeatureNorm: L2 Feature Normalization for Dynamic Graph Embedding