Network representation learning systematic review: ancestors and current development state
arXiv:2109.07583 · doi:10.1016/j.mlwa.2021.100130
Abstract
Real-world information networks are increasingly occurring across various disciplines including online social networks and citation networks. These network data are generally characterized by sparseness, nonlinearity and heterogeneity bringing different challenges to the network analytics task to capture inherent properties from network data. Artificial intelligence and machine learning have been recently leveraged as powerful systems to learn insights from network data and deal with presented challenges. As part of machine learning techniques, graph embedding approaches are originally conceived for graphs constructed from feature represented datasets, like image dataset, in which links between nodes are explicitly defined. These traditional approaches cannot cope with network data challenges. As a new learning paradigm, network representation learning has been proposed to map a real-world information network into a low-dimensional space while preserving inherent properties of the network. In this paper, we present a systematic comprehensive survey of network representation learning, known also as network embedding, from birth to the current development state. Through the undertaken survey, we provide a comprehensive view of reasons behind the emergence of network embedding and, types of settings and models used in the network embedding pipeline. Thus, we introduce a brief history of representation learning and word representation learning ancestor of network embedding. We provide also formal definitions of basic concepts required to understand network representation learning followed by a description of network embedding pipeline. Most commonly used downstream tasks to evaluate embeddings, their evaluation metrics and popular datasets are highlighted. Finally, we present the open-source libraries for network embedding.
arXiv comment65 pages 11 Figures 6 Tables
References in corpus (35)
- Efficient Estimation of Word Representations in Vector Space
- DeepWalk: Online Learning of Social Representations
- Distributed Representations of Sentences and Documents
- LINE: Large-scale Information Network Embedding
- Inductive Representation Learning on Large Graphs
- Link Prediction in Complex Networks: A Survey
- Graph Embedding Techniques, Applications, and Performance: A Survey
- Facial Expression Analysis under Partial Occlusion: A Survey
- struc2vec: Learning Node Representations from Structural Identity
- Learning Convolutional Neural Networks for Graphs
- Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features
- graph2vec: Learning Distributed Representations of Graphs
- Discriminative Embeddings of Latent Variable Models for Structured Data
- dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learning
- Efficiently Summarising Event Sequences with Rich Interleaving Patterns
- Graph Evolution: Densification and Shrinking Diameters
- Representation Learning on Graphs: Methods and Applications
- VERSE: Versatile Graph Embeddings from Similarity Measures
- Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record
- Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec
- subgraph2vec: Learning Distributed Representations of Rooted Sub-graphs from Large Graphs
- sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddings
- Onto2Vec: joint vector-based representation of biological entities and their ontology-based annotations
- Neural Code Comprehension: A Learnable Representation of Code Semantics
- Representation Learning for Natural Language Processing
- A Comparative Study for Unsupervised Network Representation Learning
- Time2Vec: Learning a Vector Representation of Time
- DeepCas: an End-to-end Predictor of Information Cascades
- Confusion2Vec: Towards Enriching Vector Space Word Representations with Representational Ambiguities
- CrisisBERT: a Robust Transformer for Crisis Classification and Contextual Crisis Embedding
- Multi-Modal Bayesian Embeddings for Learning Social Knowledge Graphs
- client2vec: Towards Systematic Baselines for Banking Applications
- Job2Vec: Job Title Benchmarking with Collective Multi-View Representation Learning
- Domain2Vec: Deep Domain Generalization
- Bib2vec: An Embedding-based Search System for Bibliographic Information