3 papers
cs.IT2025
Novel Inconsistency Results for Partial Information Decomposition
Philip Hendrik Matthias, Abdullah Makkeh, Michael Wibral +1
Partial Information Decomposition (PID) seeks to disentangle how information about a target variable is distributed across multiple sources, separating redundant, unique, and syner…
cs.IT2025
Shannon invariants: A scalable approach to information decomposition
Aaron J. Gutknecht, Fernando E. Rosas, David A. Ehrlich +3
Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns…
cs.IT2024
What should a neuron aim for? Designing local objective functions based on information theory
Andreas C. Schneider, Valentin Neuhaus, David A. Ehrlich +4
In modern deep neural networks, the learning dynamics of the individual neurons is often obscure, as the networks are trained via global optimization. Conversely, biological system…