DLLM-JEPA: Joint Embedding Predictive Architectures for Masked Diffusion Language Models

Sangdae Nam

Joint Embedding Predictive Architectures (JEPAs) have reshaped self-supervised representation learning in vision. The recent LLM-JEPA ported JEPA to autoregressive language models…