2 papers
cs.DC2026
WaveAlign: Cache-Aware Query-Row Scheduling for Sparse Attention in Long-Video Generation
Zijian Dai, Sen Han, Youhui Bai +6
Long-video generation with diffusion transformers (DiTs) produces extremely long token sequences, making attention a dominant inference bottleneck. Dynamic sparse attention reduces…
cs.LG2026
DeaMoE: Efficient MoE Structure for Fast Small-Batch Decoding
Zewen Jin, Shen Fu, Zeping Duan +8
Mixture-of-Experts (MoE) models have been widely adopted in real-time interactive applications such as coding assistants, real-time audio-video interaction systems. To meet the ext…