Mutual Information second order expansion is the Pearson's chi-square statistic

Marius Marinescu

We show that MI connects subtly and elegantly the two best-known state-of-the-art independence test statistics: the $G^2$ and the Pearson's chi-square statistic $\ddot{I}{‡}^2$. Furthermore…