works on
long-context memory 1model efficiency 1retrieval-augmented generation 1self-distillation 1transformer depth division 1

From the 1 of 2 linked papers with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

SparseForge: Efficient Semi-Structured LLM Sparsification via Annealing of Hessian-Guided Soft-Mask

Liu Hanzuo, Chaofan Lin, Weixuan Sun +4

Semi-structured sparsity provides a practical path to accelerate large language models (LLMs) with native hardware support, but post-training semi-structured pruning often suffers…