4 citations · 10 across the 14 of their papers we have counts for
5 papers · 1 filter
Principled RL for Diffusion LLMs Emerges from a Sequence-Level Perspective
Jingyang Ou, Jiaqi Han, Minkai Xu +5
Reinforcement Learning (RL) has proven highly effective for autoregressive language models, but adapting these methods to diffusion large language models (dLLMs) presents fundament…
RFG: Self-Improving Diffusion Large Language Models with Reward-Free Guidance
Tianlang Chen, Minkai Xu, Jure Leskovec +1
Diffusion Large Language Models (dLLMs) have shown strong reasoning capabilities, yet further improving them typically requires costly post-training with additional data and superv…
-PO: Generalizing Preference Optimization with -divergence Minimization
Jiaqi Han, Mingjian Jiang, Yuxuan Song +2
Preference optimization has made significant progress recently, with numerous methods developed to align language models with human preferences. This paper introduces -divergenc…
Energy-Based Diffusion Language Models for Text Generation
Minkai Xu, Tomas Geffner, Karsten Kreis +5
Despite remarkable progress in autoregressive language models, alternative generative paradigms beyond left-to-right generation are still being actively explored. Discrete diffusio…
SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
Ling Yang, Zhaochen Yu, Tianjun Zhang +4
Large language models (LLMs) like GPT-4, DeepSeek-R1, and ReasonFlux have shown significant improvements in various reasoning tasks. However, smaller LLMs still struggle with compl…