Empirical Lossless Compression Bound of a Data Sequence

Lei M Li

We consider the lossless compression bound of any individual data sequence. If we fit the data by a parametric model, the entropy quantity $nH({\hat{\theta }}_n)$ obtained by plugging in…