1 citations · 1 across the 1 of their papers we have counts for
2 papers
cs.CL2025
SWAA: Sliding Window Attention Adaptation for Efficient and Quality Preserving Long Context Processing
Yijiong Yu, Jiale Liu, Qingyun Wu +2
The quadratic complexity of self attention in Transformer based LLMs renders long context inference prohibitively expensive. While Sliding Window Attention (SWA), the simplest spar…
cs.CL2024★ 1 cited
Do LLMs Really Think Step-by-step In Implicit Reasoning?
Yijiong Yu
It has been well-known that Chain-of-Thought can remarkably enhance LLMs' performance on complex tasks. However, because it also introduces slower inference speeds and higher compu…