Edge Attention-based Multi-Relational Graph Convolutional Networks

Abstract

Graph convolutional network (GCN) is generalization of convolutional neural network (CNN) to work with arbitrarily structured graphs. A binary adjacency matrix is commonly used in training a GCN. Recently, the attention mechanism allows the network to learn a dynamic and adaptive aggregation of the neighborhood. We propose a new GCN model on the graphs where edges are characterized in multiple views or precisely in terms of multiple relationships. For instance, in chemical graph theory, compound structures are often represented by the hydrogen-depleted molecular graph where nodes correspond to atoms and edges correspond to chemical bonds. Multiple attributes can be important to characterize chemical bonds, such as atom pair (the types of atoms that a bond connects), aromaticity, and whether a bond is in a ring. The different attributes lead to different graph representations for the same molecule. There is growing interests in both chemistry and machine learning fields to directly learn molecular properties of compounds from the molecular graph, instead of from fingerprints predefined by chemists. The proposed GCN model, which we call edge attention-based multi-relational GCN (EAGCN), jointly learns attention weights and node features in graph convolution. For each bond attribute, a real-valued attention matrix is used to replace the binary adjacency matrix. By designing a dictionary for the edge attention, and forming the attention matrix of each molecule by looking up the dictionary, the EAGCN exploits correspondence between bonds in different molecules. The prediction of compound properties is based on the aggregated node features, which is independent of the varying molecule (graph) size. We demonstrate the efficacy of the EAGCN on multiple chemical datasets: Tox21, HIV, Freesolv, and Lipophilicity, and interpret the resultant attention weights.

Haven't meet my expectations

References in corpus (6)

• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Deep Convolutional Networks on Graph-Structured Data
• Atomic Convolutional Networks for Predicting Protein-Ligand Binding Affinity
• Graph-based Isometry Invariant Representation Learning

Cited by in corpus (13)

• Graph Neural Networks: Taxonomy, Advances and Trends
• Molecule Attention Transformer
• Deeply learning molecular structure-property relationships using attention- and gate-augmented graph convolutional network
• NF-GNN: Network Flow Graph Neural Networks for Malware Detection and Classification
• Multi-View Graph Neural Networks for Molecular Property Prediction
• Evolutionary Architecture Search for Graph Neural Networks
• Learning Attributed Graph Representations with Communicative Message Passing Transformer
• Robot Navigation in Crowds by Graph Convolutional Networks with Attention Learned from Human Gaze
• Explain Graph Neural Networks to Understand Weighted Graph Features in Node Classification
• Balanced Order Batching with Task-Oriented Graph Clustering
• Sparse hierarchical representation learning on molecular graphs
• Counterfactual Explanation with Multi-Agent Reinforcement Learning for Drug Target Prediction
• Using GGNN to recommend log statement level