Information-Geometric Decomposition of Generalization Error in Unsupervised Learning

Gilhan Kim

We decompose the Kullback--Leibler generalization error (GE) -- the expected KL divergence from the data distribution to the trained model -- of unsupervised learning into three no…