2 papers
cs.CV2025
Acceleration Multiple Heads Decoding for LLM via Dynamic Tree Attention
Zhendong Zhang
Multiple heads decoding accelerates the inference of Large Language Models (LLMs) by predicting next several tokens simultaneously. It generates and verifies multiple candidate seq…
cs.CV2025
Flash Window Attention: speedup the attention computation for Swin Transformer
Zhendong Zhang
To address the high resolution of image pixels, the Swin Transformer introduces window attention. This mechanism divides an image into non-overlapping windows and restricts attenti…