Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

Abstract

We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure -- this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.

References in corpus (21)

• Semi-Supervised Classification with Graph Convolutional Networks
• ADADELTA: An Adaptive Learning Rate Method
• Inductive Representation Learning on Large Graphs
• Trust Region Policy Optimization
• Fast Graph Representation Learning with PyTorch Geometric
• Junction Tree Variational Autoencoder for Molecular Graph Generation
• Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models
• GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
• MolGAN: An implicit generative model for small molecular graphs
• Learning Deep Generative Models of Graphs
• Constrained Graph Variational Autoencoders for Molecule Design
• ChemTS: An Efficient Python Library for de novo Molecular Generation
• Exploration by Random Network Distillation
• Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generation
• Syntax-Directed Variational Autoencoder for Structured Data
• Conditional molecular design with deep generative models
• Geom-GCN: Geometric Graph Convolutional Networks
• rlpyt: A Research Code Base for Deep Reinforcement Learning in PyTorch
• Molecular Hypergraph Grammar with its Application to Molecular Optimization
• Edge-Featured Graph Attention Network
• Convolutional Kernel Networks for Graph-Structured Data