Sparse Text Diffusion under Dual Budgets: Context Connectivity and Expert Activation

Alexandros Christoforos, Chadbourne Davis, Paul Raj

Long-context diffusion repeatedly pays for both token interaction and feed-forward computation. We formulate these costs as two separate budgets: the edges available to an attentio…