9 citations · 31 across the 32 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Diffusion Language Models are Super Data Learners
Jinjie Ni, Qian Liu, Longxu Dou +5
Under strictly controlled pre-training settings, we observe a Crossover: when unique data is limited, diffusion language models (DLMs) consistently surpass autoregressive (AR) mode…
cs.LG2025
Training Optimal Large Diffusion Language Models
Jinjie Ni, Qian Liu, Chao Du +5
We introduce Quokka, the first systematic scaling law for diffusion language models (DLMs), encompassing both compute-constrained and data-constrained regimes, and studying the key…
cs.LG2025
Efficient Process Reward Model Training via Active Learning
Keyu Duan, Zichen Liu, Xin Mao +5
Process Reward Models (PRMs) provide step-level supervision to large language models (LLMs), but scaling up training data annotation remains challenging for both humans and LLMs. T…