1 citations · 1 across the 4 of their papers we have counts for
3 papers · 1 filter
On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction
Eliezer Shlomi, Eliron Rahimi, Avi Mendelson +1
Diffusion language models (DLMs) promise parallel text generation, but in practice face an unresolved speed-quality trade-off. Exact decoding fills in only one masked position per…
Breaking the Bubble: Asynchronous Pipeline Parallel Training with Bounded Weight Inconsistency
Itay Elam, Eliron Rahimi, Avi Mendelson +1
Pipeline parallelism is essential for training large neural networks, but existing schedules trade off throughput, memory, and optimization consistency. Synchronous pipelines prese…
Step-Wise Refusal Dynamics in Autoregressive and Diffusion Language Models
Eliron Rahimi, Elad Hirshel, Rom Himelstein +3
Diffusion language models (DLMs) have recently emerged as a competitive alternative to autoregressive (AR) models, offering parallel decoding, competitive generation quality, and i…