Unwinding the model manifold: choosing similarity measures to remove local minima in sloppy dynamical systems

Abstract

In this paper, we consider the problem of parameter sensitivity in models of complex dynamical systems through the lens of information geometry. We calculate the sensitivity of model behavior to variations in parameters. In most cases, models are sloppy, that is, exhibit an exponential hierarchy of parameter sensitivities. We propose a parameter classification scheme based on how the sensitivities scale at long observation times. We show that for oscillatory models, either with a limit cycle or a strange attractor, sensitivities can become arbitrarily large, which implies a high effective-dimensionality on the model manifold. Sloppy models with a single fixed point have model manifolds with low effective-dimensionality, previously described as a "hyper-ribbon". In contrast, models with high effective dimensionality translate into multimodal fitting problems. We define a measure of curvature on the model manifold which we call the \emph{winding frequency} that estimates the linear density of local minima in the model's parameter space. We then show how alternative choices of fitting metrics can "unwind" the model manifold and give low winding frequencies. This prescription translates the model manifold from one of high effective-dimensionality into the "hyper-ribbon" structures observed elsewhere. This translation opens the door for applications of sloppy model analysis and model reduction methods developed for models with low effective-dimensionality.

arXiv comment16 pages, 14 figures, supplementary material merged with main article

References in corpus (12)

• Universally Sloppy Parameter Sensitivities in Systems Biology
• Parameter Space Compression Underlies Emergent Theories and Predictive Models
• The statistical mechanics of complex signaling networks : nerve growth factor signaling
• The geometry of nonlinear least squares with applications to sloppy models and optimization
• Sloppiness, robustness, and evolvability in systems biology
• Why are nonlinear fits so challenging?
• The sloppy model universality class and the Vandermonde matrix
• Bridging Mechanistic and Phenomenological Models of Complex Biological Systems
• On Statistical Methods of Parameter Estimation for Deterministically Chaotic Time-Series
• Extracting falsifiable predictions from sloppy models
• Maximizing the information learned from finite data selects a simple model
• Structural Susceptibility and Separation of Time Scales in the van der Pol Oscillator

Cited by in corpus (1)

• Stability of the manifold boundary approximation method for reductions of nuclear structure models