Optimal design of experiments by combining coarse and fine measurements
arXiv:1702.06001 · doi:10.1103/PhysRevLett.119.208101
Abstract
In many contexts it is extremely costly to perform enough high quality experimental measurements to accurately parameterize a predictive quantitative model. However, it is often much easier to carry out large numbers of experiments that indicate whether each sample is above or below a given threshold. Can many such categorical or "coarse" measurements be combined with a much smaller number of high resolution or "fine" measurements to yield accurate models? Here, we demonstrate an intuitive strategy, inspired by statistical physics, wherein the coarse measurements are used to identify the salient features of the data, while the fine measurements determine the relative importance of these features. A linear model is inferred from the fine measurements, augmented by a quadratic term that captures the correlation structure of the coarse data. We illustrate our strategy by considering the problems of predicting the antimalarial potency and aqueous solubility of small organic molecules from their 2D molecular structure.
arXiv commentTo appear in Physical Review Letters
References in corpus (12)
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Ab initio Random Structure Searching
- Noise Dressing of Financial Correlation Matrices
- Universal and non-universal properties of cross-correlations in financial time series
- Coevolutionary landscape inference and the context-dependence of mutations in beta-lactamase TEM-1
- Cleaning large correlation matrices: tools from random matrix theory
- Thermodynamics and the Global Optimization of Lennard-Jones clusters
- Characterizing the network topology of the energy landscapes of atomic clusters
- Statistical mechanics of the US Supreme Court
- Rotational invariant estimator for general noisy matrices
- Improving landscape inference by integrating heterogeneous data in the inverse Ising problem
- Inverse Ising inference with correlated samples