Is stochastic thermodynamics the key to understanding the energy costs of computation?

Abstract

The relationship between the thermodynamic and computational characteristics of dynamical physical systems has been a major theoretical interest since at least the 19th century, and has been of increasing practical importance as the energetic cost of digital devices has exploded over the last half century. One of the most important thermodynamic features of real-world computers is that they operate very far from thermal equilibrium, in finite time, with many quickly (co-)evolving degrees of freedom. Such computers also must almost always obey multiple physical constraints on how they work. For example, all modern digital computers are periodic processes, governed by a global clock. Another example is that many computers are modular, hierarchical systems, with strong restrictions on the connectivity of their subsystems. This properties hold both for naturally occurring computers, like brains or Eukaryotic cells, as well as digital systems. These features of real-world computers are absent in 20th century analyses of the thermodynamics of computational processes, which focused on quasi-statically slow processes. However, the field of stochastic thermodynamics has been developed in the last few decades - and it provides the formal tools for analyzing systems that have exactly these features of real-world computers. We argue here that these tools, together with other tools currently being developed in stochastic thermodynamics, may help us understand at a far deeper level just how the fundamental physical properties of dynamic systems are related to the computation that they perform.

arXiv commentUpdated version

References in corpus (66)

• Modularity and community structure in networks
• A nonequilibrium equality for free energy differences
• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
• Hierarchical structure and the prediction of missing links in networks
• Hierarchical Organization in Complex Networks
• Entropy production along a stochastic trajectory and an integral fluctuation theorem
• Verification of the Crooks fluctuation theorem and recovery of RNA folding free energies
• Thermodynamic uncertainty relation for biomolecular processes
• Statistical physics of inference: Thresholds and algorithms
• The physics of brain network structure, function, and control
• Experimental realization of a Szilard engine with a single electron
• Experimental Test of Quantum Jarzynski Equality with a Trapped Ion System
• Ensemble and Trajectory Thermodynamics: A Brief Introduction
• Experimental study of mutual information in a Maxwell Demon
• Broken detailed balance and non-equilibrium dynamics in living systems
• Proof of the Finite-Time Thermodynamic Uncertainty Relation for Steady-State Currents
• Hierarchy measure for complex networks
• Nonequilibrium fluctuations in a resistor
• Nonequilibrium Thermodynamics of Chemical Reaction Networks: Wisdom from Stochastic Thermodynamics
• Speed Limit for Classical Stochastic Processes
• p-Bits for Probabilistic Spin Logic
• An experimental test of the Jarzynski equality in a mechanical experiment
• Stochastic thermodynamics of chemical reaction networks
• Scalable detection of statistically significant communities and hierarchies, using message-passing for modularity
• Power and heat fluctuation theorems for electric circuits
• On the heat flux and entropy produced by thermal fluctuations
• Thermodynamic uncertainty relation for time-dependent driving
• Thermodynamic Unification of Optimal Transport: Thermodynamic Uncertainty Relation, Minimum Dissipation, and Thermodynamic Speed Limits
• Stochastic thermodynamics of computation
• Kinetic uncertainty relation
• Speed limit for open quantum systems
• Thermodynamic and Logical Reversibilities Revisited
• The dissipation-time uncertainty relation
• Hardware emulation of stochastic p-bits for invertible logic
• Thermodynamic Uncertainty Relation for Arbitrary Initial States
• Non-equilibrium brain dynamics as a signature of consciousness
• Lossless Brownian information engine
• CMOS + stochastic nanomagnets: heterogeneous computers for probabilistic inference and learning
• Thermodynamics of Gambling Demons
• The thermodynamic efficiency of computations made in cells across the range of life
• Unified thermodynamic-kinetic uncertainty relation
• Above and Beyond the Landauer Bound: Thermodynamics of Modularity
• Second law of thermodynamics at stopping times
• Programming Active Cohesive Granular Matter with Mechanically Induced Phase Changes
• Thermodynamics in Single-Electron Circuits and Superconducting Qubits
• Protein-DNA computation by stochastic assembly cascade
• Topological Speed Limit
• Geometric thermodynamics for the Fokker-Planck equation: Stochastic thermodynamic links between information geometry and optimal transport
• Thermodynamic cost and benefit of memory
• Dependence of dissipation on the initial distribution over states
• Disordered Systems Insights on Computational Hardness
• Thermodynamic costs of Turing Machines
• Physical constraints in intracellular signaling: the cost of sending a bit
• Principles of Low Dissipation Computing from a Stochastic Circuit Model
• Thermodynamics of stochastic Turing machines
• Stochastic and Quantum Thermodynamics of Driven RLC Networks
• Random Language Model
• Thermodynamics of computations with absolute irreversibility, unidirectional transitions, and stochastic computation times
• Energy consumption and cooperation for optimal sensing
• The impossibility of Landauer's bound for almost every quantum state
• Thermodynamic correlation inequality
• A Green(er) World for A.I
• Optimal work extraction and mutual information in a generalized Szilárd engine
• Entropy production given constraints on the energy functions
• Work, entropy production, and thermodynamics of information under protocol constraints

Cited by in corpus (18)

• Martingales for physicists: A treatise on stochastic thermodynamics and beyond
• Landauer Principle and Thermodynamics of Computation
• Conditional fluctuation theorems and entropy production for monitored quantum systems under imperfect detection
• Maximizing free energy gain
• Stochastic thermodynamic bounds on logical circuit operation
• Experimentally achieving minimal dissipation via thermodynamically optimal transport
• Autonomous Quantum Processing Unit: An Autonomous Thermal Computing Machine & its Physical Limitations
• State-space kinetic Ising model reveals task-dependent entropy flow in sparsely active nonequilibrium neuronal dynamics
• Noise equals control
• Fluctuation theorems with optical tweezers: theory and practice
• Thermodynamic Constraints in Dynamic Random-Access Memory Cells: Experimental Verification of Energy Efficiency Limits in Information Erasure
• Optimally Fast Qubit Reset
• Estimation of Energy-dissipation Lower-bounds for Neuromorphic Learning-in-memory
• Thermodynamic characterization of message-passing: Framework and initial study
• Join gate with memory in token-conserving Brownian circuits and the thermodynamic cost
• Thermodynamic speed limit for non-adiabatic work and its classical-quantum decomposition
• Extra cost of erasure due to quantum lifetime broadening
• Improving the efficiency of finite-time memory erasure with potential barrier shaping