Shannon Meets Carnot: Generalized Second Thermodynamic Law

Abstract

The classical thermodynamic laws fail to capture the behavior of systems with energy Hamiltonian which is an explicit function of the temperature. Such Hamiltonian arises, for example, in modeling information processing systems, like communication channels, as thermal systems. Here we generalize the second thermodynamic law to encompass systems with temperature-dependent energy levels, $dQ=TdS+<d\mathcal{E}/dT>dT$, where $<\cdot >$ denotes averaging over the Boltzmann distribution and reveal a new definition to the basic notion of temperature. This generalization enables to express, for instance, the mutual information of the Gaussian channel as a consequence of the fundamental laws of nature - the laws of thermodynamics.

References in corpus (1)

• The information bottleneck method

Cited by in corpus (9)

• An information theoretic approach to statistical dependence: copula information
• Statistical Physics of Signal Estimation in Gaussian Noise: Theory and Examples of Phase Transitions
• Optomechanical oscillator controlled by variation in its heat bath temperature
• Heat capacities of thermally manipulated mechanical oscillator at strong coupling
• Internal Geometric Friction in a Kitaev Chain Heat Engine
• Mutual information via thermodynamics: Three different approaches
• Another Look at the Physics of Large Deviations With Application to Rate-Distortion Theory
• Topological and Finite Size Effects in a Kitaev Chain Heat Engine
• Carnot in the Information Age: Discrete Symmetric Channels