Predictive Closure: A Set-Level Characterization of JEPA's Feature Selection

Mosh Levy, Aly Lidayan, Yoav Goldberg

In joint-embedding predictive architectures (JEPA), an encoder and a predictor are trained together to produce a representation that minimizes the error in predicting the represent…