Stochastic thermodynamics of computation

Abstract

One of the major resource requirements of computers - ranging from biological cells to human brains to high-performance (engineered) computers - is the energy used to run them. Those costs of performing a computation have long been a focus of research in physics, going back to the early work of Landauer. One of the most prominent aspects of computers is that they are inherently nonequilibrium systems. However, the early research was done when nonequilibrium statistical physics was in its infancy, which meant the work was formulated in terms of equilibrium statistical physics. Since then there have been major breakthroughs in nonequilibrium statistical physics, which are allowing us to investigate the myriad aspects of the relationship between statistical physics and computation, extending well beyond the issue of how much work is required to erase a bit. In this paper I review some of this recent work on the `stochastic thermodynamics of computation'. After reviewing the salient parts of information theory, computer science theory, and stochastic thermodynamics, I summarize what has been learned about the entropic costs of performing a broad range of computations, extending from bit erasure to loop-free circuits to logically reversible circuits to information ratchets to Turing machines. These results reveal new, challenging engineering problems for how to design computers to have minimal thermodynamic costs. They also allow us to start to combine computer science theory and stochastic thermodynamics at a foundational level, thereby expanding both.

113 pages, no figures. arXiv admin note: text overlap with arXiv:1901.00386

References in corpus (65)

• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• The role of quantum information in thermodynamics --- a topical review
• Dissipation bounds all steady-state current fluctuations
• Quantum speed limits: from Heisenberg's uncertainty principle to optimal quantum control
• Dissipation: The phase-space perspective
• Entropy production as correlation between system and reservoir
• Second Law of Thermodynamics with Discrete Quantum Feedback Control
• Minimal Energy Cost for Thermodynamic Information Processing: Measurement and Information Erasure
• Three detailed fluctuation theorems
• Universal trade-off between power, efficiency, and constancy in steady-state heat engines
• Stochastic thermodynamics under coarse-graining
• Second law and Landauer principle far from equilibrium
• Ensemble and Trajectory Thermodynamics: A Brief Introduction
• The resource theory of informational nonequilibrium in thermodynamics
• The Three Faces of the Second Law: I. Master Equation Formulation
• Thermoelectric efficiency at maximum power in a quantum dot
• Work and information processing in a solvable model of Maxwell's demon
• Quantum and Information Thermodynamics: A Unifying Framework based on Repeated Interactions
• Nonequilibrium Thermodynamics of Feedback Control
• The thermodynamics of prediction
• The Energetic Costs of Cellular Computation
• Finite-time generalization of the thermodynamic uncertainty relation
• Information processing and the second law of thermodynamics: an inclusive, Hamiltonian approach
• Information-theoretic approach to the study of control systems
• Thermodynamic costs of information processing in sensory adaption
• Information Thermodynamics on Causal Networks
• Simple bounds on fluctuations and uncertainty relations for first-passage times of counting observables
• Quantum Speed Limit is Not Quantum
• NP-complete Problems and Physical Reality
• Maxwell's Refrigerator: An Exactly Solvable Model
• Fundamental Bounds on First Passage Time Fluctuations for Currents
• Unifying Three Perspectives on Information Processing in Stochastic Thermodynamics
• Thermodynamic and Logical Reversibilities Revisited
• An autonomous and reversible Maxwell's demon
• Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes
• Finite time thermodynamics for a single level quantum dot
• Generalization of the Second Law for a Nonequilibrium Initial State
• Generalising Landauer's Principle
• Thermodynamics of Error Correction
• Finite-time erasing of information stored in fermionic bits
• A Resource Theory for Work and Heat
• Multipartite information flow for multiple Maxwell demons
• Above and Beyond the Landauer Bound: Thermodynamics of Modularity
• Second laws under control restrictions
• The thermodynamics of computational copying in biochemical systems
• Near-optimal protocols in complex nonequilibrium transformations
• Stochastic Thermodynamics of Learning
• Landauer in the age of synthetic biology: energy consumption and information processing in biochemical networks
• Computational Mechanics of Input-Output Processes: Structured transformations and the $\epsilon$-transducer
• Fundamental costs in the production and destruction of persistent polymer copies
• Correlation-powered Information Engines and the Thermodynamics of Self-Correction
• Thermodynamic cost of external control
• Dependence of dissipation on the initial distribution over states
• Thermodynamics of stochastic Turing machines
• Thermodynamics of complexity and pattern manipulation
• Relations between Entropies Produced in Nondeterministic Thermodynamic Processes
• Leveraging Environmental Correlations: The Thermodynamics of Requisite Variety
• Transient Dissipation and Structural Costs of Physical Information Transduction
• The free energy requirements of biological organisms; implications for evolution
• From empirical data to continuous Markov processes: a systematic approach
• Extending Landauer's Bound from Bit Erasure to Arbitrary Computation
• Landauer Bound for Analog Computing Systems
• Stochastic thermodynamics for kinetic equations
• Information flow and entropy production on Bayesian networks
• A thermodynamically consistent model of finite state machines

Cited by in corpus (47)

• Colloquium: Quantum and Classical Discrete Time Crystals
• Thermodynamic Unification of Optimal Transport: Thermodynamic Uncertainty Relation, Minimum Dissipation, and Thermodynamic Speed Limits
• Finite-Time Quantum Landauer Principle and Quantum Coherence
• Stochastic Thermodynamics of Non-Linear Electronic Circuits: A Realistic Framework for Computing around kT
• Energetic cost of Hamiltonian quantum gates
• Programming Active Cohesive Granular Matter with Mechanically Induced Phase Changes
• Thermodynamics of computing with circuits
• Is stochastic thermodynamics the key to understanding the energy costs of computation?
• The Two Kinds of Free Energy and the Bayesian Revolution
• Macroscopic Stochastic Thermodynamics
• Ergotropy from quantum and classical correlations
• Physical constraints in intracellular signaling: the cost of sending a bit
• Thermodynamic costs of Turing Machines
• Principles of Low Dissipation Computing from a Stochastic Circuit Model
• Uncertainty relations and fluctuation theorems for Bayes nets
• Thermodynamic Computing via Autonomous Quantum Thermal Machines
• Fundamental energy cost of finite-time computing
• Stochastic thermodynamics of relativistic Brownian motion
• Thermodynamics of computations with absolute irreversibility, unidirectional transitions, and stochastic computation times
• Stochastic thermodynamics with arbitrary interventions
• Classical Information Theory of Networks
• Landauer Principle and Thermodynamics of Computation
• Intrinsic and extrinsic thermodynamics for stochastic population processes with multi-level large-deviation structure
• Dependence of integrated, instantaneous, and fluctuating entropy production on the initial state in quantum and classical processes
• Nonequilibrium physics of brain dynamics
• Quantum Foundations of Classical Reversible Computing
• Stochastic thermodynamics and fluctuation theorems for non-linear systems
• From a feedback-controlled demon to an information ratchet in a double quantum dot
• Stochastic thermodynamic bounds on logical circuit operation
• Hamiltonian Memory: An Erasable Classical Bit
• Fate of Duplicated Neural Structures
• Entropy production given constraints on the energy functions
• Nonequilibrium thermodynamics of uncertain stochastic processes
• Thermodynamic cost of Brownian computers in the stochastic thermodynamics of resetting
• Minimal thermodynamic cost of communication
• Experimental nonequilibrium memory erasure beyond Landauer's bound
• Dissipation enables robust extensive scaling of multipartite correlations
• Increasing the clock speed of a thermodynamic computer by adding noise
• From reductionism to realism: Holistic mathematical modelling for complex biological systems
• Work, entropy production, and thermodynamics of information under protocol constraints
• Thermodynamic Constraints in Dynamic Random-Access Memory Cells: Experimental Verification of Energy Efficiency Limits in Information Erasure
• Revisiting thermodynamics in computation and information theory
• Fluctuation theorems for multiple co-evolving systems
• Bounds on the rates of statistical divergences and mutual information via stochastic thermodynamics
• Bridging the Band Gap: What Device Physicists Need to Know About Machine Learning
• Pipelined information flow in molecular mechanical circuits leads to increased error and irreversibility
• Thermodynamic Signature of Logical Depth in Quantum Circuits