High-Dimensional Latents Should Be Diagnosed Through Phase Structure

Alejandro Ascarate, Leo Lebrat, Rodrigo Santa Cruz +2

We study autoencoder and variational-autoencoder latent spaces through the lens of spin-glass theory. The paper has two components. First, we formalize a latent-space spin-glass di…