Showing 2025Show all
2 papers · 1 filter
cs.CL2025
Learning When Not to Attend Globally
Xuan Luo, Kailai Zhang, Xifeng Yan
When reading books, humans focus primarily on the current page, flipping back to recap prior context only when necessary. Similarly, we demonstrate that Large Language Models (LLMs…
cs.CL2025
Direct Multi-Token Decoding
Xuan Luo, Weizhi Wang, Xifeng Yan
Decoder-only transformers have become the standard architecture for large language models (LLMs) due to their strong performance. Recent studies suggest that, in pre-trained LLMs,…