Fundamental Inequalities and Identities Involving Mutual and Directed Informations in Closed-Loop Systems

Milan S. Derpich, Eduardo I. Silva, Jan Østergaard

We present several novel identities and inequalities relating the mutual information and the directed information in systems with feedback. The internal blocks within such systems…