4 papers · 1 filter
Clock Diffusion: Efficient Semi-Autoregressive Continuous Diffusion Language Models
Yair Schiff, Omer Belhasin, Roy Uziel +7
Recent works on continuous diffusion for discrete data have demonstrated performance on par with comparable discrete diffusion models. However, these continuous counterparts lack k…
LiLiCorr: Lightweight Likelihood Correlation of Parallel Drafts for Speculative Decoding
Matan Rusanovsky, Yoav Miron, Roy Uziel +5
Speculative decoding accelerates language-model inference by drafting future tokens the target model verifies in parallel. A diffusion-style drafter such as DFlash drafts an entire…
CRoCoDiL: Continuous and Robust Conditioned Diffusion for Language
Roy Uziel, Omer Belhasin, Itay Levy +4
Masked Diffusion Models (MDMs) provide an efficient non-causal alternative to autoregressive generation but often struggle with token dependencies and semantic incoherence due to t…
Learn from Your Mistakes: Self-Correcting Masked Diffusion Models
Yair Schiff, Omer Belhasin, Roy Uziel +6
Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models, enabling parallel token generation while achieving competitive performance. Despite…