The Entropy Gain of Linear Time-Invariant Filters and Some of its Implications

Milan S. Derpich, Matías Müller, Jan Østergaard

We study the increase in per-sample differential entropy rate of random sequences and processes after being passed through a non minimum-phase (NMP) discrete-time, linear time-inva…