Markovian description of a wide class of feedback-controlled systems: Application to the feedback flashing ratchet
arXiv:2404.04195 · doi:10.1088/1742-5468/ad64bb
Abstract
In feedback-controlled systems, an external agent -- the feedback controller -- measures the state of the system and modifies its subsequent dynamics depending on the outcome of the measurement. In this paper, we build a Markovian description for the joint stochastic process that comprises both the system and the controller variables. This Markovian description is valid for a wide class of feedback-controlled systems, allowing for the inclusion of errors in the measurement. The general framework is motivated and illustrated with the paradigmatic example of the feedback flashing ratchet.
42 pages, 9 figures; major revision with respect to v1, accepted for publication in JSTAT
References in corpus (19)
- Integral fluctuation theorem for the housekeeping heat
- Thermodynamics of feedback controlled systems
- Feedback control in a collective flashing ratchet
- Realization of a feedback controlled flashing ratchet
- Minimum entropy production, detailed balance and Wasserstein distance for continuous-time Markov processes
- Driving rapidly while remaining in control: classical shortcuts from Hamiltonian to stochastic dynamics
- Information and flux in a feedback controlled Brownian ratchet
- Housekeeping and excess entropy production for general nonlinear dynamics
- Geometric thermodynamics for the Fokker-Planck equation: Stochastic thermodynamic links between information geometry and optimal transport
- Quantum Fokker-Planck Master Equation for Continuous Feedback Control
- Geometric decomposition of entropy production into excess, housekeeping and coupling parts
- Rocking feedback controlled ratchets
- Maximal fluctuation exploitation in Gaussian information engines
- Extracting work optimally with imprecise measurements
- Thermodynamic Uncertainty Relations for Steady-State Thermodynamics
- Unlocking the potential of information flow: Maximizing free-energy transduction in a model of an autonomous rotary molecular motor
- Two applications of stochastic thermodynamics to hydrodynamics
- Information in feedback ratchets
- Deep reinforcement learning for feedback control in a collective flashing ratchet