Estimating information in time-varying signals
arXiv:1812.11884 · doi:10.1371/journal.pcbi.1007290
Abstract
Across diverse biological systems -- ranging from neural networks to intracellular signaling and genetic regulatory networks -- the information about changes in the environment is frequently encoded in the full temporal dynamics of the network nodes. A pressing data-analysis challenge has thus been to efficiently estimate the amount of information that these dynamics convey from experimental data. Here we develop and evaluate decoding-based estimation methods to lower bound the mutual information about a finite set of inputs, encoded in single-cell high-dimensional time series data. For biological reaction networks governed by the chemical Master equation, we derive model-based information approximations and analytical upper bounds, against which we benchmark our proposed model-free decoding estimators. In contrast to the frequently-used k-nearest-neighbor estimator, decoding-based estimators robustly extract a large fraction of the available information from high-dimensional trajectories with a realistic number of data samples. We apply these estimators to previously published data on Erk and Ca signaling in mammalian cells and to yeast stress-response, and find that substantial amount of information about environmental state can be encoded by non-trivial response statistics even in stationary signals. We argue that these single-cell, decoding-based information estimates, rather than the commonly-used tests for significant differences between selected population response statistics, provide a proper and unbiased measure for the performance of biological signaling networks.
arXiv comment32 pages
References in corpus (17)
- Measuring Information Transfer
- Estimating Mutual Information
- Optimal decoding of information from a genetic network
- Mutual information between in- and output trajectories of biochemical networks
- Information transmission in genetic regulatory networks: a review
- Optimizing information flow in small genetic networks. I
- Information capacity of genetic regulatory elements
- Optimizing information flow in small genetic networks. II: Feed forward interactions
- Mutual information in time-varying biochemical systems
- High accuracy decoding of dynamical motion from a large retinal population
- Capacity of a Simple Intercellular Signal Transduction Channel
- Noise and information transmission in promoters with multiple internal states
- Optimizing information flow in small genetic networks. III. A self-interacting gene
- Dynamic sampling and information encoding in biochemical networks
- Multiplexing Biochemical Signals
- Extending the dynamic range of transcription factor action by translational regulation
- Information loss in an optimal maximum likelihood decoding