SNoRe: Scalable Unsupervised Learning of Symbolic Node Representations
arXiv:2009.04535 · doi:10.1109/ACCESS.2020.3039541
Abstract
Learning from complex real-life networks is a lively research area, with recent advances in learning information-rich, low-dimensional network node representations. However, state-of-the-art methods are not necessarily interpretable and are therefore not fully applicable to sensitive settings in biomedical or user profiling tasks, where explicit bias detection is highly relevant. The proposed SNoRe (Symbolic Node Representations) algorithm is capable of learning symbolic, human-understandable representations of individual network nodes, based on the similarity of neighborhood hashes which serve as features. SNoRe's interpretable features are suitable for direct explanation of individual predictions, which we demonstrate by coupling it with the widely used instance explanation tool SHAP to obtain nomograms representing the relevance of individual features for a given classification. To our knowledge, this is one of the first such attempts in a structural node embedding setting. In the experimental evaluation on eleven real-life datasets, SNoRe proved to be competitive to strong baselines, such as variational graph autoencoders, node2vec and LINE. The vectorized implementation of SNoRe scales to large networks, making it suitable for contemporary network learning and analysis tasks.
Accepted to IEEEAccess
References in corpus (21)
- Scikit-learn: Machine Learning in Python
- Distributed Representations of Words and Phrases and their Compositionality
- The NumPy array: a structure for efficient numerical computation
- A Comprehensive Survey on Graph Neural Networks
- DeepWalk: Online Learning of Social Representations
- LINE: Large-scale Information Network Embedding
- Inductive Representation Learning on Large Graphs
- Link Prediction in Complex Networks: A Survey
- Predicting Missing Links via Local Information
- Representation Learning on Graphs with Jumping Knowledge Networks
- Variational Graph Auto-Encoders
- Analyzing and Modeling Real-World Phenomena with Complex Networks: A Survey of Applications
- PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks
- Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec
- Pitfalls of Graph Neural Network Evaluation
- Predict then Propagate: Graph Neural Networks meet Personalized PageRank
- Node Classification in Social Networks
- Unifying Graph Convolutional Neural Networks and Label Propagation
- Propositionalization and Embeddings: Two Sides of the Same Coin
- Embedding-based Silhouette Community Detection
- Symbolic Graph Embedding using Frequent Pattern Mining