129 citations
4 papers
The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing
David P. Feldman, Carl S. McTague, James P. Crutchfield
Intrinsic computation refers to how dynamical systems store, structure, and transform historical and spatial information. By graphing a measure of structural complexity against a m…
Structural Information in Two-Dimensional Patterns: Entropy Convergence and Excess Entropy
David P. Feldman, James P. Crutchfield
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can…
Synchronizing to Periodicity: The Transient Information and Synchronization Time of Periodic Sequences
David P. Feldman, James P. Crutchfield
We analyze how difficult it is to synchronize to a periodic sequence whose structure is known, when an observer is initially unaware of the sequence's phase. We examine the transie…
Regularities Unseen, Randomness Observed: Levels of Entropy Convergence
James P. Crutchfield, David P. Feldman
We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applyin…