1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.CL2026
CoMem: Reusing Transformer Depth across Queries with Persistent Intermediate Residuals
Hanzuo Liu, Xuan Qi, Chunyu Liu +6
Repeated queries over shared documents repeatedly execute the same lower transformer layers. We introduce CoMem, which makes split depth j an explicit reusable-context axis: write…
cs.LG2026
SparseForge: Efficient Semi-Structured LLM Sparsification via Annealing of Hessian-Guided Soft-Mask
Liu Hanzuo, Chaofan Lin, Weixuan Sun +4
Semi-structured sparsity provides a practical path to accelerate large language models (LLMs) with native hardware support, but post-training semi-structured pruning often suffers…
cs.LG2024★ 1 cited
FastSwitch: Optimizing Context Switching Efficiency in Fairness-aware Large Language Model Serving
Ao Shen, Zhiyao Li, Mingyu Gao
Serving numerous users and requests concurrently requires good fairness in Large Language Models (LLMs) serving system. This ensures that, at the same cost, the system can meet the…