Word-Valued Sources: an Ergodic Theorem, an AEP and the Conservation of Entropy

Roy Timo, Kim Blackmore, Leif Hanlen

A word-valued source $\mathbf{Y}=Y_1,Y_2,...$ is discrete random process that is formed by sequentially encoding the symbols of a random process $\mathbf{X}=X_1,X_2,...$ with c…