Adversarially Regularized Graph Attention Networks for Inductive Learning on Partially Labeled Graphs

Abstract

The high cost of data labeling often results in node label shortage in real applications. To improve node classification accuracy, graph-based semi-supervised learning leverages the ample unlabeled nodes to train together with the scarce available labeled nodes. However, most existing methods require the information of all nodes, including those to be predicted, during model training, which is not practical for dynamic graphs with newly added nodes. To address this issue, an adversarially regularized graph attention model is proposed to classify newly added nodes in a partially labeled graph. An attention-based aggregator is designed to generate the representation of a node by aggregating information from its neighboring nodes, thus naturally generalizing to previously unseen nodes. In addition, adversarial training is employed to improve the model's robustness and generalization ability by enforcing node representations to match a prior distribution. Experiments on real-world datasets demonstrate the effectiveness of the proposed method in comparison with the state-of-the-art methods. The code is available at https://github.com/JiarenX/AGAIN.

References in corpus (16)

• Scikit-learn: Machine Learning in Python
• DeepWalk: Online Learning of Social Representations
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• LINE: Large-scale Information Network Embedding
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Spectral Networks and Locally Connected Networks on Graphs
• The information bottleneck method
• Graph Embedding Techniques, Applications, and Performance: A Survey
• Adversarial Attacks on Neural Networks for Graph Data
• Security Evaluation of Pattern Classifiers under Attack
• GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs
• Adversarial Attack on Graph Structured Data
• Certifiable Robustness and Robust Training for Graph Convolutional Networks
• Modeling documents with Generative Adversarial Networks

Cited by in corpus (3)

• Semi-supervised Domain Adaptation on Graphs with Contrastive Learning and Minimax Entropy
• IMMENSE: Inductive Multi-perspective User Classification in Social Networks
• Leveraging Medical Foundation Model Features in Graph Neural Network-Based Retrieval of Breast Histopathology Images