The sloppy model universality class and the Vandermonde matrix

Abstract

In a variety of contexts, physicists study complex, nonlinear models with many unknown or tunable parameters to explain experimental data. We explain why such systems so often are sloppy; the system behavior depends only on a few `stiff' combinations of the parameters and is unchanged as other `sloppy' parameter combinations vary by orders of magnitude. We contrast examples of sloppy models (from systems biology, variational quantum Monte Carlo, and common data fitting) with systems which are not sloppy (multidimensional linear regression, random matrix ensembles). We observe that the eigenvalue spectra for the sensitivity of sloppy models have a striking, characteristic form, with a density of logarithms of eigenvalues which is roughly constant over a large range. We suggest that the common features of sloppy models indicate that they may belong to a common universality class. In particular, we motivate focusing on a Vandermonde ensemble of multiparameter nonlinear models and show in one limit that they exhibit the universal features of sloppy models.

New content added

Cited by in corpus (16)

• Extracting falsifiable predictions from sloppy models
• Delineating Parameter Unidentifiabilities in Complex Models
• Cause and Cure of Sloppiness in Ordinary Differential Equation Models
• KLIFF: A framework to develop physics-based and machine learning interatomic potentials
• Bayesian, frequentist, and information geometric approaches to parametric uncertainty quantification of classical empirical interatomic potentials
• Thermodynamic curvature for a two-parameter spin model with frustration
• Variational inference of fractional Brownian motion with linear computational complexity
• Optimal experimental design in an EGFR signaling and down-regulation model
• Frequency Domain Identifiability and Sloppiness of Descriptor Systems with an LFT Structure
• Does the Data Induce Capacity Control in Deep Learning?
• Classical and Bayesian error analysis of the relativistic mean-field model for doubly magic nuclei
• Sloppy models can be identifiable
• Managing Expectations and Imbalanced Training Data in Reactive Force Field Development: an Application to Water Adsorption on Alumina
• Parameters inference and model reduction for the Single-Particle Model of Li ion cells
• The limits of statistical significance of Hawkes processes fitted to financial data
• Extending OpenKIM with an Uncertainty Quantification Toolkit for Molecular Modeling