Massively Multitask Networks for Drug Discovery

Abstract

Massively multitask neural architectures provide a learning framework for drug discovery that synthesizes information from many distinct biological sources. To train these architectures at scale, we gather large amounts of data from public sources to create a dataset of nearly 40 million measurements across more than 200 biological targets. We investigate several aspects of the multitask framework by performing a series of empirical studies and obtain some interesting results: (1) massively multitask networks obtain predictive accuracies significantly better than single-task methods, (2) the predictive power of multitask networks improves as additional tasks and data are added, (3) the total amount of data and the total number of tasks both contribute significantly to multitask improvement, and (4) multitask networks afford limited transferability to tasks not in the training set. Our results underscore the need for greater data sharing and further algorithmic innovation to accelerate the drug discovery process.

Preliminary work. Under review by the International Conference on Machine Learning (ICML)

References in corpus (2)

• Going Deeper with Convolutions
• Multi-task Neural Networks for QSAR Predictions

Cited by in corpus (15)

• An Overview of Multi-Task Learning in Deep Neural Networks
• Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
• Relational Graph Attention Networks
• An Integrated Transfer Learning and Multitask Learning Approach for Pharmacokinetic Parameter Prediction
• Toxicity Prediction using Deep Learning
• Overcoming data scarcity with transfer learning
• Learning Graph-Level Representation for Drug Discovery
• Parallel and Distributed Thompson Sampling for Large-scale Accelerated Exploration of Chemical Space
• Generating Focussed Molecule Libraries for Drug Discovery with Recurrent Neural Networks
• Step Change Improvement in ADMET Prediction with PotentialNet Deep Featurization
• Intra-day Activity Better Predicts Chronic Conditions
• Comparison of multi-task convolutional neural network (MT-CNN) and a few other methods for toxicity prediction
• Multi-task Deep Neural Networks in Automated Protein Function Prediction
• Multi-Task Learning for Argumentation Mining
• Landscape of Big Medical Data: A Pragmatic Survey on Prioritized Tasks