Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
When Does Sparsity Mitigate the Curse of Depth in LLMs
Dilxat Muhtar, Xinyuan Song, Sebastian Pokutta +4
Recent work has demonstrated the curse of depth in large language models (LLMs), where later layers contribute less to learning and representation than earlier layers. Such under-u…
cs.CL2026
ActTail: Global Activation Sparsity in Large Language Models
Wenwen Hou, Xinyuan Song, Shiwei Liu +1
Activation sparsity is a promising approach for accelerating large language model (LLM) inference by reducing computation and memory movement. However, existing activation sparsity…