2 citations · 2 across the 4 of their papers we have counts for
4 papers
Novel Inconsistency Results for Partial Information Decomposition
Philip Hendrik Matthias, Abdullah Makkeh, Michael Wibral +1
We prove that three cornerstone properties of classical information theory, namely non-negativity of information, the chain rule, and invariance under invertible transformations, b…
Redundancy Maximization as a Principle of Associative Memory Learning in Hopfield Networks
Mark Blümel, Andreas C. Schneider, Valentin Neuhaus +5
Associative memory, traditionally modeled by Hopfield networks, enables the retrieval of previously stored patterns from partial or noisy cues. Yet, the local computational princip…
Shannon invariants: A scalable approach to information decomposition
Aaron J. Gutknecht, Fernando E. Rosas, David A. Ehrlich +3
Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns…
What should a neuron aim for? Designing local objective functions based on information theory
Andreas C. Schneider, Valentin Neuhaus, David A. Ehrlich +4
In modern deep neural networks, the learning dynamics of the individual neurons is often obscure, as the networks are trained via global optimization. Conversely, biological system…