Heterogeneous Molecular Graph Neural Networks for Predicting Molecule Properties

Abstract

As they carry great potential for modeling complex interactions, graph neural network (GNN)-based methods have been widely used to predict quantum mechanical properties of molecules. Most of the existing methods treat molecules as molecular graphs in which atoms are modeled as nodes. They characterize each atom's chemical environment by modeling its pairwise interactions with other atoms in the molecule. Although these methods achieve a great success, limited amount of works explicitly take many-body interactions, i.e., interactions between three and more atoms, into consideration. In this paper, we introduce a novel graph representation of molecules, heterogeneous molecular graph (HMG) in which nodes and edges are of various types, to model many-body interactions. HMGs have the potential to carry complex geometric information. To leverage the rich information stored in HMGs for chemical prediction problems, we build heterogeneous molecular graph neural networks (HMGNN) on the basis of a neural message passing scheme. HMGNN incorporates global molecule representations and an attention mechanism into the prediction process. The predictions of HMGNN are invariant to translation and rotation of atom coordinates, and permutation of atom indices. Our model achieves state-of-the-art performance in 9 out of 12 tasks on the QM9 dataset.

arXiv commentTo appear as a conference paper at ICDM 2020

References in corpus (12)

• Semi-Supervised Classification with Graph Convolutional Networks
• Neural Message Passing for Quantum Chemistry
• An Overview of Multi-Task Learning in Deep Neural Networks
• SchNet - a deep learning architecture for molecules and materials
• On the Convergence of Adam and Beyond
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments and Partial Charges
• Machine Learning Unifies the Modelling of Materials and Molecules
• Machine learning prediction errors better than DFT accuracy
• Group Equivariant Convolutional Networks
• Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
• Neural Message Passing with Edge Updates for Predicting Properties of Molecules and Materials

Cited by in corpus (2)

• Discovery of structure-property relations for molecules via hypothesis-driven active learning over the chemical space
• HeMI: Multi-view Embedding in Heterogeneous Graphs