Concentration of empirical entropy and transfer entropy for non-regular chains with unbounded memory

José O. Santana, Ricardo F. Ferreira

We study plug-in estimators of the entropy rate and the transfer entropy rate for stationary finite-alphabet chains with unbounded memory. Under a coalescent coupling-from-the-past…