Parameter Space Compression Underlies Emergent Theories and Predictive Models

Abstract

We report a similarity between the microscopic parameter dependance of emergent theories in physics and that of multiparameter models common in other areas of science. In both cases, predictions are possible despite large uncertainties in the microscopic parameters because these details are compressed into just a few governing parameters that are sufficient to describe relevant observables. We make this commonality explicit by examining parameter sensitivity in a hopping model of diffusion and a generalized Ising model of ferromagnetism. We trace the emergence of a smaller effective model to the development of a hierarchy of parameter importance quantified by the eigenvalues of the Fisher Information Matrix. Strikingly, the same hierarchy appears ubiquitously in models taken from diverse areas of science. We conclude that the emergence of effective continuum and universal theories in physics is due to the same parameter space hierarchy that underlies predictive modeling in other areas of science.

5 pages, 3 figures + 9 page Supplement, 1 additional figure

References in corpus (1)

• The sloppy model universality class and the Vandermonde matrix

Cited by in corpus (85)

• A review on locomotion robophysics: the study of movement at the intersection of robotics, soft matter and dynamical systems
• Caliber based spectral gap optimization of order parameters (SGOOP) for sampling complex molecular systems
• Mutual Information, Neural Networks and the Renormalization Group
• Stochastic time-evolution, information geometry and the Cramer-Rao Bound
• Deformation of crystals: Connections with statistical physics
• The limitations of model-based experimental design and parameter estimation in sloppy systems
• Resolving coiled shapes reveals new reorientation behaviors in C. elegans
• On the role of theory and modeling in neuroscience
• PCA meets RG
• Bridging Mechanistic and Phenomenological Models of Complex Biological Systems
• A dissipation bound for thermodynamic control
• Simple predictions from multifield inflationary models
• Geometry of learning neural quantum states
• Maximizing the information learned from finite data selects a simple model
• A Critical-like Collective State Leads to Long-range Cell Communication in Dictyostelium discoideum Aggregation
• Generative models versus underlying symmetries to explain biological pattern
• A dynamical network model for age-related health deficits and mortality
• Cause and Cure of Sloppiness in Ordinary Differential Equation Models
• Visualizing probabilistic models: Intensive Principal Component Analysis
• Landmark Diffusion Maps (L-dMaps): Accelerated manifold learning out-of-sample extension
• Predicting how and when hidden neurons skew measured synaptic interactions
• The renormalisation group via statistical inference
• Emergence of dynamic properties in network hyper-motifs
• Thermodynamics and computation during collective motion near criticality
• Sloppy nuclear energy density functionals: effective model reduction
• Learning Maximum Entropy Models from finite size datasets: a fast Data-Driven algorithm allows sampling from the posterior distribution
• Geometric framework to predict structure from function in neural networks
• Optimal Renormalization Group Transformation from Information Theory
• Bayesian, frequentist, and information geometric approaches to parametric uncertainty quantification of classical empirical interatomic potentials
• On the correspondence between thermodynamics and inference
• Thermodynamic curvature for a two-parameter spin model with frustration
• Theoretical ecology without species
• Reliability of analog quantum simulation
• Relevance in the Renormalization Group and in Information Theory
• Bayesian Renormalization
• Chebyshev approximation and the global geometry of sloppy models
• Untangling the hairball: fitness based asymptotic reduction of biological networks
• Strategic model reduction by analysing model sloppiness: a case study in coral calcification
• What the foundations of quantum computer science teach us about chemistry
• Universal properties of concentration sensing in large ligand-receptor networks
• Quantitative Molecular Scaling Theory of Protein Amino Acid Sequences, Structure, and Functionality
• "Sloppy" nuclear energy density functionals (II): Finite nuclei
• Visualizing probabilistic models in Minkowski space with intensive symmetrized Kullback-Leibler embedding
• Network Renormalization
• A scaling law from discrete to continuous solutions of channel capacity problems in the low-noise limit
• Signal detection in nearly continuous spectra and symmetry breaking
• Fitting a function to time-dependent ensemble averaged data
• Causal Geometry
• Online storage ring optimization using dimension-reduction and genetic algorithms
• Variational Bayesian strategies for high-dimensional, stochastic design problems
• Glycan processing in the Golgi -- optimal information coding and constraints on cisternal number and enzyme specificity
• Inferring relevant features: from QFT to PCA
• Unwinding the model manifold: choosing similarity measures to remove local minima in sloppy dynamical systems
• Unveiling Order from Chaos by approximate 2-localization of random matrices
• Principles underlying efficient exciton transport unveiled by information-geometric analysis
• Canalisation and plasticity on the developmental manifold of Caenorhabditis elegans
• Automated adaptive inference of coarse-grained dynamical models in systems biology
• Far from Asymptopia
• Quantum System Compression: A Hamiltonian Guided Walk Through Hilbert Space
• Electrostatic Point Charge Fitting as an Inverse Problem: Revealing the Underlying Ill-Conditioning
• Hierarchical Network Structure Promotes Dynamical Robustness
• Physical networks become what they learn
• The Lindley paradox: The loss of resolution in Bayesian inference
• Information-based inference for singular models and finite sample sizes: A frequentist information criterion
• Stability of the manifold boundary approximation method for reductions of nuclear structure models
• Sparse model from optimal nonuniform embedding of time series
• Inferring phenomenological models of first passage processes
• Discovering sparse control strategies in C. elegans
• Applications of information geometry to spiking neural network behavior
• Classical and Bayesian error analysis of the relativistic mean-field model for doubly magic nuclei
• Developing Parameter-Reduction Methods on a Biophysical Model of Auditory Hair Cells
• NCoder -- A Quantum Field Theory approach to encoding data
• A topological approach to the problem of emergence in complex systems
• Sloppy models can be identifiable
• Intrinsic regularization effect in Bayesian nonlinear regression scaled by observed data
• Multiparameter optimal control of F1-ATPase
• Parameters inference and model reduction for the Single-Particle Model of Li ion cells
• Geometric Foundation of Nonequilibrium Transport: A Minkowski Embedding of Markov Dynamics
• Gaussian Information Bottleneck and the Non-Perturbative Renormalization Group
• Information loss under coarse-graining: a geometric approach
• Information Geometry and the Renormalization Group
• Exploration of the Parameter Space in Macroeconomic Agent-Based Models
• Minimizing couplings in renormalization by preserving short-range mutual information
• Discerning media bias within a network of political allies: an analytic condition for disruption by partisans
• Extending OpenKIM with an Uncertainty Quantification Toolkit for Molecular Modeling