10 papers
Exploring More to Solve More: Boosting Diversity in Text Diffusion Models via Entropy-Based Guidance
Jingwei Zhang, Haoyu Lei, Zijin Feng +2
Although diffusion models have revolutionized continuous domains like image synthesis through high quality generations and controllable guidance mechanisms, bringing this controlla…
Stabilizing Reinforcement Learning for Diffusion Language Models
Jianyuan Zhong, Kaibo Wang, Ding Ding +5
Group Relative Policy Optimization (GRPO) is highly effective for post-training autoregressive (AR) language models, yet its direct application to diffusion large language models (…
Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes
Fangyu Ding, Ding Ding, Sijin Chen +8
While Masked Diffusion Language Models (MDLMs) relying on token masking and unmasking have shown promise in language modeling, their computational efficiency and generation flexibi…
HERMES: Towards Efficient and Verifiable Mathematical Reasoning in LLMs
Azim Ospanov, Zijin Feng, Jiacheng Sun +3
Informal mathematics has been central to modern large language model (LLM) reasoning, offering flexibility and efficient construction of arguments. However, purely informal reasoni…
ProofFlow: A Dependency Graph Approach to Faithful Proof Autoformalization
Rafael Cabral, Tuan Manh Do, Xuejun Yu +3
Proof autoformalization, the task of translating natural language theorems and proofs into machine-verifiable code, is a critical step for integrating large language models into ri…
Masked Diffusion Models as Energy Minimization
Sitong Chen, Shen Nie, Jiacheng Sun +4
We present a systematic theoretical framework that interprets masked diffusion models (MDMs) as solutions to energy minimization problems in discrete optimal transport. Specificall…