Is the reconstruction loss culprit? An attempt to outperform JEPA

Alexey Potapov, Oleg Shcherbakov, Ivan Kravchenko

We evaluate JEPA-style predictive representation learning versus reconstruction-based autoencoders on a controlled "TV-series" linear dynamical system with known latent state and a…