Designing Spatial Architectures for Sparse Attention: STAR Accelerator via Cross-Stage Tiling

Huizheng Wang, Taiquan Wei, Hongbin Wang +6

Large language models (LLMs) rely on self-attention for contextual understanding, demanding high-throughput inference and large-scale token parallelism (LTPP). Existing dynamic spa…