Emergence of functional information from multivariate correlations
arXiv:2109.07933 · doi:10.1098/rsta.2021.0250
Abstract
The information content of symbolic sequences (such as nucleic- or amino acid sequences, but also neuronal firings or strings of letters) can be calculated from an ensemble of such sequences, but because information cannot be assigned to single sequences, we cannot correlate information to other observables attached to the sequence. Here we show that an information score obtained from multivariate (multiple-variable) correlations within sequences of a "training" ensemble can be used to predict observables of out-of-sample sequences with an accuracy that scales with the complexity of correlations, showing that functional information emerges from a hierarchy of multi-variable correlations.
arXiv comment20 pages, 5 figures
References in corpus (11)
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Are biological systems poised at criticality?
- Network information and connected correlations
- Information theory in molecular biology
- Measuring the tendency of CNNs to Learn Surface Statistical Regularities
- The use of information theory in evolutionary biology
- Physical Complexity of Symbolic Sequences
- Inference of entropies of discrete random variables with unknown cardinalities
- Strong Selection Significantly Increases Epistatic Interactions in the Long-Term Evolution of a Protein
- Discovery and information-theoretic characterization of transcription factor binding sites that act cooperatively
- Information-theoretic characterization of the complete genotype-phenotype map of a complex pre-biotic world