6 papers
Same Compression Principle, Different Geometry: Rate-Distortion Signatures Dissociate Biological and Artificial Visual Systems
Leyla Roksan Caglar, Pedro A. M. Mediano, Baihan Lin
Efficient coding theory predicts that biological perceptual systems compress sensory input optimally under resource constraints, with the systematic structure of errors reflecting…
The mathematical landscape of partial information decomposition: A comprehensive review of properties and measures
Alberto Liardi, Keenan J. A. Down, George Blackburne +2
Partial Information Decomposition (PID) has become one of the most prominent information-theoretic frameworks for describing the structure and quality of information in complex sys…
Directional Confusions Reveal Divergent Inductive Biases Through Rate-Distortion Geometry in Human and Machine Vision
Leyla Roksan Caglar, Pedro A. M. Mediano, Baihan Lin
To humans, a robin seems more like a bird than a bird seems like a robin, but does this asymmetry also hold for machine vision? Humans and modern vision models can match each other…
Integrated information theory: the good, the bad and the misunderstood
Adam B. Barrett, Borjan Milinkovic, Pedro A. M. Mediano +4
The integrated information theory of consciousness (IIT) is uniquely ambitious in proposing a mathematical formula, derived from apparently fundamental properties of conscious expe…
From Data Statistics to Feature Geometry: How Correlations Shape Superposition
Lucas Prieto, Edward Stevinson, Melih Barsbey +2
A central idea in mechanistic interpretability is that neural networks represent more features than they have dimensions, arranging them in superposition to form an over-complete b…
Shannon invariants: A scalable approach to information decomposition
Aaron J. Gutknecht, Fernando E. Rosas, David A. Ehrlich +3
Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns…