Redundancy and synergy in dual decompositions of mutual information gain and information loss

Daniel Chicharro, Stefano Panzeri

Williams and Beer (2010) proposed a nonnegative mutual information decomposition, based on the construction of information gain lattices, which allows separating the information th…