The Origins of Computational Mechanics: A Brief Intellectual History and Several Clarifications
arXiv:1710.06832
Abstract
The principle goal of computational mechanics is to define pattern and structure so that the organization of complex systems can be detected and quantified. Computational mechanics developed from efforts in the 1970s and early 1980s to identify strange attractors as the mechanism driving weak fluid turbulence via the method of reconstructing attractor geometry from measurement time series and in the mid-1980s to estimate equations of motion directly from complex time series. In providing a mathematical and operational definition of structure it addressed weaknesses of these early approaches to discovering patterns in natural systems. Since then, computational mechanics has led to a range of results from theoretical physics and nonlinear mathematics to diverse applications---from closed-form analysis of Markov and non-Markov stochastic processes that are ergodic or nonergodic and their measures of information and intrinsic computation to complex materials and deterministic chaos and intelligence in Maxwellian demons to quantum compression of classical processes and the evolution of computation and language. This brief review clarifies several misunderstandings and addresses concerns recently raised regarding early works in the field (1980s). We show that misguided evaluations of the contributions of computational mechanics are groundless and stem from a lack of familiarity with its basic goals and from a failure to consider its historical context. For all practical purposes, its modern methods and results largely supersede the early works. This not only renders recent criticism moot and shows the solid ground on which computational mechanics stands but, most importantly, shows the significant progress achieved over three decades and points to the many intriguing and outstanding challenges in understanding the computational nature of complex dynamic systems.
arXiv comment11 pages, 123 citations; http://csc.ucdavis.edu/~cmg/compmech/pubs/cmr.htm
References in corpus (29)
- Computational Mechanics: Pattern and Prediction, Structure and Simplicity
- Occam's Quantum Razor: How Quantum Mechanics can reduce the complexity of classical models
- Time's Barbed Arrow: Irreversibility, Crypticity, and Stored Information
- Prediction, Retrodiction, and The Amount of Information Stored in the Present
- Demon Dynamics: Deterministic Chaos, the Szilard Map, and the Intelligence of Thermodynamic Systems
- Bayesian Structural Inference for Hidden Processes
- Inferring hidden Markov models from noisy time sequences: a method to alleviate degeneracy in molecular dynamics
- What did Erwin Mean? The Physics of Information from the Materials Genomics of Aperiodic Crystals and Water to Molecular Information Catalysts and Life
- Chaos Forgets and Remembers: Measuring Information Creation, Destruction, and Storage
- A Closed-Form Shave from Occam's Quantum Razor: Exact Results for Quantum Compression
- Exact Synchronization for Finite-State Sources
- The application of computational mechanics to the analysis of geomagnetic data
- Many Roads to Synchrony: Natural Time Scales and Their Algorithms
- Information Symmetries in Irreversible Processes
- Transient Dissipation and Structural Costs of Physical Information Transduction
- Nearly Maximally Predictive Features and Their Dimensions
- Information Anatomy of Stochastic Equilibria
- Statistical Signatures of Structural Organization: The case of long memory in renewal processes
- Thermodynamics of Random Number Generation
- Enumerating Finitary Processes
- Structure or Noise?
- The Markov Memory for Generating Rare Events
- Diffraction Patterns of Layered Close-packed Structures from Hidden Markov Models
- Extreme Quantum Advantage when Simulating Strongly Coupled Classical Systems
- The Past and the Future in the Present
- Trimming the Independent Fat: Sufficient Statistics, Mutual Information, and Predictability from Effective Channel States
- Information Accessibility and Cryptic Processes: Linear Combinations of Causal States
- A Physics-Based Approach to Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems
- The Ambiguity of Simplicity