Discrete JEPA: Learning Discrete Token Representations without Reconstruction

Junyeob Baek, Hosung Lee, Christopher Hoang +2

The cornerstone of cognitive intelligence lies in extracting hidden patterns from observations and leveraging these principles to systematically predict future outcomes. However, c…