Autofocused oracles for model-based design

Abstract

Data-driven design is making headway into a number of application areas, including protein, small-molecule, and materials engineering. The design goal is to construct an object with desired properties, such as a protein that binds to a therapeutic target, or a superconducting material with a higher critical temperature than previously observed. To that end, costly experimental measurements are being replaced with calls to high-capacity regression models trained on labeled data, which can be leveraged in an in silico search for design candidates. However, the design goal necessitates moving into regions of the design space beyond where such models were trained. Therefore, one can ask: should the regression model be altered as the design algorithm explores the design space, in the absence of new data? Herein, we answer this question in the affirmative. In particular, we (i) formalize the data-driven design problem as a non-zero-sum game, (ii) develop a principled strategy for retraining the regression model as the design algorithm proceeds---what we refer to as autofocusing, and (iii) demonstrate the promise of autofocusing empirically.

arXiv comment23 pages, 6 figures

References in corpus (9)

• Auto-Encoding Variational Bayes
• Practical Bayesian Optimization of Machine Learning Algorithms
• Rényi Divergence and Kullback-Leibler Divergence
• Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems
• Machine learning-assisted directed protein evolution with combinatorial libraries
• Generating and designing DNA with deep generative models
• Bias Correction of Learned Generative Models using Likelihood-Free Importance Weighting
• Policy Optimization via Importance Sampling
• Model Inversion Networks for Model-Based Optimization

Cited by in corpus (7)

• Lattice Thermal Conductivity Prediction using Symbolic Regression and Machine Learning
• Conformal Prediction Under Feedback Covariate Shift for Biomolecular Design
• Is novelty predictable?
• A primer on model-guided exploration of fitness landscapes for biological sequence design
• Deep Extrapolation for Attribute-Enhanced Generation
• Offline Model-Based Optimization via Normalized Maximum Likelihood Estimation
• Data-Driven Offline Optimization For Architecting Hardware Accelerators