The fundamental thermodynamic bounds on finite models
arXiv:1912.03217 · doi:10.1063/5.0044741
Abstract
The minimum heat cost of computation is subject to bounds arising from Landauer's principle. Here, I derive bounds on finite modelling -- the production or anticipation of patterns (time-series data) -- by devices that model the pattern in a piecewise manner and are equipped with a finite amount of memory. When producing a pattern, I show that the minimum dissipation is proportional to the information in the model's memory about the pattern's history that never manifests in the device's future behaviour and must be expunged from memory. I provide a general construction of model that allow this dissipation to be reduced to zero. By also considering devices that consume, or effect arbitrary changes on a pattern, I discuss how these finite models can form an information reservoir framework consistent with the second law of thermodynamics.
arXiv commentAuthor accepted manuscript
References in corpus (28)
- A nonequilibrium equality for free energy differences
- The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
- Computational Mechanics: Pattern and Prediction, Structure and Simplicity
- Work and information processing in a solvable model of Maxwell's demon
- The thermodynamics of prediction
- Truly work-like work extraction
- Information processing and the second law of thermodynamics: an inclusive, Hamiltonian approach
- Occam's Quantum Razor: How Quantum Mechanics can reduce the complexity of classical models
- Time's Barbed Arrow: Irreversibility, Crypticity, and Stored Information
- Statistical Complexity of Simple 1D Spin Systems
- Anatomy of a Bit: Information in a Time Series Observation
- Above and Beyond the Landauer Bound: Thermodynamics of Modularity
- Identifying Functional Thermodynamics in Autonomous Maxwellian Ratchets
- A practical, unitary simulator for non-Markovian complex processes
- Computational Mechanics of Input-Output Processes: Structured transformations and the -transducer
- Correlation-powered Information Engines and the Thermodynamics of Self-Correction
- Exact Synchronization for Finite-State Sources
- Using quantum theory to reduce the complexity of input-output processes
- Thermodynamics of complexity and pattern manipulation
- Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation
- Information Symmetries in Irreversible Processes
- Leveraging Environmental Correlations: The Thermodynamics of Requisite Variety
- The classical-quantum divergence of complexity in modelling spin chains
- How Hidden are Hidden Processes? A Primer on Crypticity and Entropy Convergence
- Information-theoretic bound on the energy cost of stochastic simulation
- Asymptotic Synchronization for Finite-State Sources
- Thermal Efficiency of Quantum Memory Compression
- Prediction and Generation of Binary Markov Processes: Can a Finite-State Fox Catch a Markov Mouse?