Interplay of synergy and redundancy in diamond motif
arXiv:1708.06922 · doi:10.1063/1.5044606
Abstract
The formalism of partial information decomposition provides independent or non-overlapping components constituting total information content provided by a set of source variables about the target variable. These components are recognised as unique information, synergistic information and, redundant information. The metric of net synergy, conceived as the difference between synergistic and redundant information, is capable of detecting synergy, redundancy and, information independence among stochastic variables. And it can be quantified, as it is done here, using appropriate combinations of different Shannon mutual information terms. Utilisation of such a metric in network motifs with the nodes representing different biochemical species, involved in information sharing, uncovers rich store for interesting results. In the current study, we make use of this formalism to obtain a comprehensive understanding of the relative information processing mechanism in a diamond motif and two of its sub-motifs namely bifurcation and integration motif embedded within the diamond motif. The emerging patterns of synergy and redundancy and their effective contribution towards ensuring high fidelity information transmission are duly compared in the sub-motifs and independent motifs (bifurcation and integration). In this context, the crucial roles played by various time scales and activation coefficients in the network topologies are especially emphasised. We show that the origin of synergy and redundancy in information transmission can be physically justified by decomposing diamond motif into bifurcation and integration motif.
arXiv commentRevised version, 23 pages, 8 figures
References in corpus (26)
- Quantifying unique information
- Information flow and optimization in transcriptional control
- Nonnegative Decomposition of Multivariate Information
- Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
- A Bivariate Measure of Redundant Information
- Mutual information between in- and output trajectories of biochemical networks
- Information transmission in genetic regulatory networks: a review
- Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
- Signal detection, modularity and the correlation between extrinsic and intrinsic noise in biochemical networks
- Optimizing information flow in small genetic networks. I
- Optimal signal processing in small stochastic biochemical networks
- Information capacity of genetic regulatory elements
- Optimizing information flow in small genetic networks. II: Feed forward interactions
- The role of input noise in transcriptional regulation
- Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes
- Exact results for noise power spectra in linear biochemical reaction networks
- Mutual information in time-varying biochemical systems
- Noise Characteristics of Feed Forward Loops
- The effect of feedback on the fidelity of information transmission of time-varying signals
- The linear-noise approximation and the chemical master equation exactly agree up to second-order moments for a class of chemical systems
- Noise Filtering and Prediction in Biological Signaling Networks
- Genetic redundancies enhance information transfer in noisy regulatory circuits
- Redundancy in the information transmission in a two-step cascade
- Role of relaxation time scale in noisy signal transduction
- Time-dependent information transmission in a model regulatory circuit
- Role of functionality in two-component signal transduction: A stochastic study