Universally Sloppy Parameter Sensitivities in Systems Biology

Abstract

Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring \emph{in vivo} biochemical parameters is difficult, and collectively fitting them to other data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a `sloppy' spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.

Submitted to PLoS Computational Biology. Supplementary Information available in "Other Formats" bundle. Discussion slightly revised to add historical context

References in corpus (1)

• The sloppy model universality class and the Vandermonde matrix

Cited by in corpus (137)

• Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
• Parameter Space Compression Underlies Emergent Theories and Predictive Models
• A review on locomotion robophysics: the study of movement at the intersection of robotics, soft matter and dynamical systems
• The geometry of nonlinear least squares with applications to sloppy models and optimization
• Sloppiness, robustness, and evolvability in systems biology
• Why are nonlinear fits so challenging?
• The limitations of model-based experimental design and parameter estimation in sloppy systems
• Efficient inference of parsimonious phenomenological models of cellular dynamics using S-systems and alternating regression
• On the role of theory and modeling in neuroscience
• Bayesian Parameter Estimation for Dynamical Models in Systems Biology
• Simplicity of Completion Time Distributions for Common Complex Biochemical Processes
• PCA meets RG
• Bridging Mechanistic and Phenomenological Models of Complex Biological Systems
• Induction kinetics of a conditional pH stress response system in Escherichia coli
• Bistability of an In Vitro Synthetic Autoregulatory Switch
• Degeneracy in epilepsy: Multiple Routes to Hyperexcitable Brain Circuits and their Repair
• When the optimal is not the best: parameter estimation in complex biological models
• Growth of bacteria in 3-d colonies
• Extracting falsifiable predictions from sloppy models
• Maximizing the information learned from finite data selects a simple model
• Bayesian Structural Inference for Hidden Processes
• Manifold learning for parameter reduction
• Delineating Parameter Unidentifiabilities in Complex Models
• Generative models versus underlying symmetries to explain biological pattern
• Cause and Cure of Sloppiness in Ordinary Differential Equation Models
• A parameter-free model discrimination criterion based on steady-state coplanarity
• Trading bits in the readout from a genetic network
• Predicting how and when hidden neurons skew measured synaptic interactions
• Sloppy nuclear energy density functionals: effective model reduction
• Geometry of energy landscapes and the optimizability of deep neural networks
• The energy costs of biological insulators
• Critical neuronal models with relaxed timescales separation
• A robust two-gene oscillator at the core of Ostreococcus tauri circadian clock
• Parametric Estimation of Ordinary Differential Equations with Orthogonality Conditions
• Bayesian, frequentist, and information geometric approaches to parametric uncertainty quantification of classical empirical interatomic potentials
• Parameter identifiability in PDE models of fluorescence recovery after photobleaching
• The potential for complex computational models of aging
• An introduction to Bootstrap for nuclear physics
• Data efficiency and extrapolation trends in neural network interatomic potentials
• Using posterior predictive distributions to analyse epidemic models: COVID-19 in Mexico City
• Lattice Boltzmann simulations capture the multiscale physics of soft flowing crystals
• Parameter Estimation with Dense and Convolutional Neural Networks Applied to the FitzHugh-Nagumo ODE
• Comparative Analysis of Viterbi Training and Maximum Likelihood Estimation for HMMs
• Untangling the hairball: fitness based asymptotic reduction of biological networks
• Soft Modes as a Predictive Framework for Low Dimensional Biological Systems across Scales
• Chebyshev approximation and the global geometry of sloppy models
• A computational analysis of the dynamic roles of talin, Dok1, and PIPKI for integrin activation
• Strategic model reduction by analysing model sloppiness: a case study in coral calcification
• Universal properties of concentration sensing in large ligand-receptor networks
• Biophysical models of intrinsic homeostasis: Firing rates and beyond
• Accelerated Sensitivity Analysis in High-Dimensional Stochastic Reaction Networks
• Bayesian Analysis of ODE's: solver optimal accuracy and Bayes factors
• Visualizing probabilistic models in Minkowski space with intensive symmetrized Kullback-Leibler embedding
• Structural Susceptibility and Separation of Time Scales in the van der Pol Oscillator
• A scaling law from discrete to continuous solutions of channel capacity problems in the low-noise limit
• Causal Geometry
• Unlocking ensemble ecosystem modelling for large and complex networks
• Variational Bayesian strategies for high-dimensional, stochastic design problems
• Glycan processing in the Golgi -- optimal information coding and constraints on cisternal number and enzyme specificity
• Spectral Discovery of Jointly Smooth Features for Multimodal Data
• Prediction uncertainty and optimal experimental design for learning dynamical systems
• Variational method for estimating the rate of convergence of Markov Chain Monte Carlo algorithms
• Untwining multiple parameters at the exclusive zero-coincidence points with quantum control
• Unwinding the model manifold: choosing similarity measures to remove local minima in sloppy dynamical systems
• Canalisation and plasticity on the developmental manifold of Caenorhabditis elegans
• Metabolic coordination and phase transitions in spatially distributed multi-cellular systems
• Predictive Modeling, Pattern Recognition, and Spatiotemporal Representations of Plant Growth in Simulated and Controlled Environments: A Comprehensive Review
• Contact-mediated cellular communication supplements positional information to regulate spatial patterning during development
• Optimizing Threshold - Schedules for Approximate Bayesian Computation Sequential Monte Carlo Samplers: Applications to Molecular Systems
• Information Geometry and Sequential Monte Carlo
• Automated adaptive inference of coarse-grained dynamical models in systems biology
• A regularization method for the parameter estimation problem in ordinary differential equations via discrete optimal control theory
• Data-driven quantification of robustness and sensitivity of cell signaling networks
• Reproducibility and FAIR Principles: The Case of a Segment Polarity Network Model
• Inferring the dynamics of ionic currents from recursive piecewise data assimilation of approximate neuron models
• Characterization of partially accessible anisotropic spin chains in the presence of anti-symmetric exchange
• Optimal encoding in stochastic latent-variable Models
• Hierarchical Network Structure Promotes Dynamical Robustness
• A subsystems approach for parameter estimation of ODE models of hybrid systems
• A Bayesian approach to parameter identification with an application to Turing systems
• Weak transcription factor clustering at binding sites can facilitate information transfer from molecular signals
• Observability and Structural Identifiability of Nonlinear Biological Systems
• Transfer Functions for Protein Signal Transduction: Application to a Model of Striatal Neural Plasticity
• Saturation Probabilities of Continuous-Time Sigmoidal Networks
• Regularized Nonlinear Regression for Simultaneously Selecting and Estimating Key Model Parameters
• Parameter Estimation in Computational Biology by Approximate Bayesian Computation coupled with Sensitivity Analysis
• Does the Data Induce Capacity Control in Deep Learning?
• Stability of the manifold boundary approximation method for reductions of nuclear structure models
• The jigsaw puzzle of sequence phenotype inference: Piecing together Shannon entropy, importance sampling, and Empirical Bayes
• Simulation-based model selection for dynamical systems in systems and population biology
• Interference limits resolution of selection pressures from linked neutral diversity
• Mathematical models of the Arabidopsis circadian oscillator
• Self-organization of signal transduction
• Developing Parameter-Reduction Methods on a Biophysical Model of Auditory Hair Cells
• Sloppy models can be identifiable
• Quantum-like approaches unveil the intrinsic limits of predictability in compartmental models
• Sampling parameters of ordinary differential equations with Langevin dynamics that satisfy constraints
• Applications of information geometry to spiking neural network behavior
• Local learning rules to attenuate forgetting in neural networks
• Analysis of sloppiness in model simulations: unveiling parameter uncertainty when mathematical models are fitted to data
• Inferring phenomenological models of first passage processes
• Some mathematical tools for the Lenski experiment
• On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo
• Identification of Nonlinear Systems with Stable Limit Cycles via Convex Optimization
• Parameters inference and model reduction for the Single-Particle Model of Li ion cells
• Parameter inference and model selection in signaling pathway models
• Proteins with greater influence on network dynamics evolve more slowly but are not more essential
• gPC-based robustness analysis of neural systems through probabilistic recurrence metrics
• Circuit design in biology and machine learning. I. Random networks and dimensional reduction
• Modelling techniques for biomolecular networks
• Managing Expectations and Imbalanced Training Data in Reactive Force Field Development: an Application to Water Adsorption on Alumina
• Geometric Foundation of Nonequilibrium Transport: A Minkowski Embedding of Markov Dynamics
• Coarse-graining stochastic biochemical networks: quasi-stationary approximation and fast simulations using a stochastic path integral technique
• Chance, long tails, and inference: a non-Gaussian, Bayesian theory of vocal learning in songbirds
• Parameter estimation and bifurcation analysis of stochastic models of gene regulatory networks: tensor-structured methods
• Optimizing information transmission in optogenetic Wnt signaling
• The recent advances in the mathematical modelling of human pluripotent stem cells
• Dynamic Parameter Estimation of Brain Mechanisms
• Adaptive mutation of biochemical reaction constants: Fisher's geometrical model without pleiotropy
• Sensitivity analysis methods in the biomedical sciences
• Observational nonidentifiability, generalized likelihood and free energy
• Memory Lower Bounds for Randomized Collaborative Search and Applications to Biology
• Dynamic modeling of gene expression in prokaryotes: application to glucose-lactose diauxie in Escherichia coli
• Global optimization using Gaussian Processes to estimate biological parameters from image data
• A Step-by-Step Guide to Using BioNetFit
• Parameter redundancy in Type III functional response models with consumer interference
• On the Parameter Combinations That Matter and on Those That do Not
• Exploration of the Parameter Space in Macroeconomic Agent-Based Models
• Ensemble Control of Finite Dimensional Time-Varying Linear Systems
• A ghost mechanism: An analytical model of abrupt learning in recurrent networks
• Revisiting the Excess Volatility Puzzle Through the Lens of the Chiarella Model
• Simulation of Gene Regulatory Networks
• Prediction Stability in a data-based mechanistic model of sigmaF during sporulation in Bacillus subtilis
• SteatoNet- Modelling steatosis identifies candidate systemic flux distribution deregulations
• The Limits of Inference in Complex Systems: When Stochastic Models Become Indistinguishable
• Parametric Sensitivity Analysis for Biochemical Reaction Networks based on Pathwise Information Theory
• An introduction to the mathematical modelling of iPSCs