Automated 3D Pre-Training for Molecular Property Prediction

Abstract

Molecular property prediction is an important problem in drug discovery and materials science. As geometric structures have been demonstrated necessary for molecular property prediction, 3D information has been combined with various graph learning methods to boost prediction performance. However, obtaining the geometric structure of molecules is not feasible in many real-world applications due to the high computational cost. In this work, we propose a novel 3D pre-training framework (dubbed 3D PGT), which pre-trains a model on 3D molecular graphs, and then fine-tunes it on molecular graphs without 3D structures. Based on fact that bond length, bond angle, and dihedral angle are three basic geometric descriptors corresponding to a complete molecular 3D conformer, we first develop a multi-task generative pre-train framework based on these three attributes. Next, to automatically fuse these three generative tasks, we design a surrogate metric using the \textit{total energy} to search for weight distribution of the three pretext task since total energy corresponding to the quality of 3D conformer.Extensive experiments on 2D molecular graphs are conducted to demonstrate the accuracy, efficiency and generalization ability of the proposed 3D PGT compared to various pre-training baselines.

References in corpus (9)

• The Open Catalyst 2020 (OC20) Dataset and Community Challenges
• GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training
• Self-Supervised Graph Transformer on Large-Scale Molecular Data
• Principal Neighbourhood Aggregation for Graph Nets
• Pre-training Molecular Graph Representation with 3D Geometry
• GemNet: Universal Directional Graph Neural Networks for Molecules
• Representing Long-Range Context for Graph Neural Networks with Global Attention
• Global Self-Attention as a Replacement for Graph Convolution
• GRPE: Relative Positional Encoding for Graph Transformer