A Framework for Joint Unsupervised Learning of Cluster-Aware Embedding for Heterogeneous Networks

Abstract

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for network analysis as it enables downstream tasks such as clustering and node classification. In this work, we propose \ours for joint learning of cluster embeddings as well as cluster-aware HIN embedding. We assume that the connected nodes are highly likely to fall in the same cluster, and adopt a variational approach to preserve the information in the pairwise relations in a cluster-aware manner. In addition, we deploy contrastive modules to simultaneously utilize the information in multiple meta-paths, thereby alleviating the meta-path selection problem - a challenge faced by many of the famous HIN embedding approaches. The HIN embedding, thus learned, not only improves the clustering performance but also preserves pairwise proximity as well as the high-order HIN structure. We show the effectiveness of our approach by comparing it with many competitive baselines on three real-world datasets on clustering and downstream node classification.

References in corpus (21)

• Scikit-learn: Machine Learning in Python
• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Categorical Reparameterization with Gumbel-Softmax
• Tutorial on Variational Autoencoders
• Fast Graph Representation Learning with PyTorch Geometric
• struc2vec: Learning Node Representations from Structural Identity
• Convolutional Networks on Graphs for Learning Molecular Fingerprints
• Variational Graph Auto-Encoders
• Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks
• Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering
• Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders
• Spatial prisoner's dilemma game with volunteering in Newman-Watts small-world networks
• Fake News Detection on Social Media using Geometric Deep Learning
• Heterogeneous Information Network Embedding for Meta Path based Proximity
• Variational Deep Embedding: An Unsupervised and Generative Approach to Clustering
• Structural Deep Embedding for Hyper-Networks
• Heterogeneous Deep Graph Infomax
• Graph Clustering with Graph Neural Networks
• CommunityGAN: Community Detection with Generative Adversarial Nets