Edge-featured Graph Neural Architecture Search

Abstract

Graph neural networks (GNNs) have been successfully applied to learning representation on graphs in many relational tasks. Recently, researchers study neural architecture search (NAS) to reduce the dependence of human expertise and explore better GNN architectures, but they over-emphasize entity features and ignore latent relation information concealed in the edges. To solve this problem, we incorporate edge features into graph search space and propose Edge-featured Graph Neural Architecture Search to find the optimal GNN architecture. Specifically, we design rich entity and edge updating operations to learn high-order representations, which convey more generic message passing mechanisms. Moreover, the architecture topology in our search space allows to explore complex feature dependence of both entities and edges, which can be efficiently optimized by differentiable search strategy. Experiments at three graph tasks on six datasets show EGNAS can search better GNNs with higher performance than current state-of-the-art human-designed and searched-based GNNs.

References in corpus (24)

• Adam: A Method for Stochastic Optimization
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• Neural Architecture Search with Reinforcement Learning
• Geometric deep learning: going beyond Euclidean data
• Large-Scale Evolution of Image Classifiers
• Gated Graph Sequence Neural Networks
• PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search
• SNAS: Stochastic Neural Architecture Search
• Understanding and Robustifying Differentiable Architecture Search
• DARTS+: Improved Differentiable Architecture Search with Early Stopping
• Residual Gated Graph ConvNets
• Principal Neighbourhood Aggregation for Graph Nets
• Benchmarking Graph Neural Networks
• Hierarchical Representations for Efficient Architecture Search
• Automated Machine Learning on Graphs: A Survey
• Auto-GNN: Neural Architecture Search of Graph Neural Networks
• DARTS-: Robustly Stepping out of Performance Collapse Without Indicators
• Edge-Featured Graph Attention Network
• Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling
• Building powerful and equivariant graph neural networks with structural message-passing
• Rethinking Graph Neural Architecture Search from Message-passing
• Graph Neural Network Architecture Search for Molecular Property Prediction