Automated Graph Learning via Population Based Self-Tuning GCN

Abstract

Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and graph classification. Traditional GCN models suffer from the issues of overfitting and oversmoothing, while some recent techniques like DropEdge could alleviate these issues and thus enable the development of deep GCN. However, training GCN models is non-trivial, as it is sensitive to the choice of hyperparameters such as dropout rate and learning weight decay, especially for deep GCN models. In this paper, we aim to automate the training of GCN models through hyperparameter optimization. To be specific, we propose a self-tuning GCN approach with an alternate training algorithm, and further extend our approach by incorporating the population based training scheme. Experimental results on three benchmark datasets demonstrate the effectiveness of our approaches on optimizing multi-layer GCN, compared with several representative baselines.

arXiv commentThis manuscript has been accepted by the SIGIR2021

References in corpus (8)

• Inductive Representation Learning on Large Graphs
• Graph Neural Networks: A Review of Methods and Applications
• DropEdge: Towards Deep Graph Convolutional Networks on Node Classification
• Simple and Deep Graph Convolutional Networks
• Auto-GNN: Neural Architecture Search of Graph Neural Networks
• Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions
• Evolutionary Architecture Search for Graph Neural Networks
• Graph Neural Network Architecture Search for Molecular Property Prediction