57 citations · 194 across the 19 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.CV2026
Improving Video Sparse Attention with Fine-grained Router and Sparse Rebasing
Peiyuan Zhang, Guoqiang Wei, Yilong Zhao +7
We present VSA2, a frontier trainable sparse attention for video DiTs. VSA2 includes a variety of new architectural features and training procedures that we apply across all stages…
cs.DC2026
Unleashing Scalable Context Parallelism for Foundation Models Pre-Training via FCP
Yilong Zhao, Xiaonan Nie, Kan Zhu +6
Context parallelism (CP) has been widely adopted to support the growing context length in foundation model pretraining. However, existing designs fail to handle the large variation…