Network Embedding via Deep Prediction Model
arXiv:2104.13323 · doi:10.1109/TBDATA.2022.3194643
Abstract
Network-structured data becomes ubiquitous in daily life and is growing at a rapid pace. It presents great challenges to feature engineering due to the high non-linearity and sparsity of the data. The local and global structure of the real-world networks can be reflected by dynamical transfer behaviors among nodes. This paper proposes a network embedding framework to capture the transfer behaviors on structured networks via deep prediction models. We first design a degree-weight biased random walk model to capture the transfer behaviors on the network. Then a deep network embedding method is introduced to preserve the transfer possibilities among the nodes. A network structure embedding layer is added into conventional deep prediction models, including Long Short-Term Memory Network and Recurrent Neural Network, to utilize the sequence prediction ability. To keep the local network neighborhood, we further perform a Laplacian supervised space optimization on the embedding feature representations. Experimental studies are conducted on various datasets including social networks, citation networks, biomedical network, collaboration network and language network. The results show that the learned representations can be effectively used as features in a variety of tasks, such as clustering, visualization, classification, reconstruction and link prediction, and achieve promising performance compared with state-of-the-arts.
References in corpus (21)
- Efficient Estimation of Word Representations in Vector Space
- Sequence to Sequence Learning with Neural Networks
- DeepWalk: Online Learning of Social Representations
- Semi-Supervised Classification with Graph Convolutional Networks
- LINE: Large-scale Information Network Embedding
- Graph Convolutional Neural Networks for Web-Scale Recommender Systems
- Spectral Networks and Locally Connected Networks on Graphs
- Graph Embedding Techniques, Applications, and Performance: A Survey
- struc2vec: Learning Node Representations from Structural Identity
- Learning Convolutional Neural Networks for Graphs
- Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec
- Large-Scale Learnable Graph Convolutional Networks
- Attributed Network Embedding for Learning in a Dynamic Environment
- SHINE: Signed Heterogeneous Information Network Embedding for Sentiment Link Prediction
- Representation Learning on Graphs: Methods and Applications
- VERSE: Versatile Graph Embeddings from Similarity Measures
- GraphGAN: Graph Representation Learning with Generative Adversarial Nets
- Network Enhancement: a general method to denoise weighted biological networks
- Adversarial Network Embedding
- FREDE: Anytime Graph Embeddings
- Spectral Clustering of Attributed Multi-relational Graphs