Sliding-Window Merging for Compacting Patch-Redundant Layers in LLMs

Xuan Ding, Rui Sun, Yunjian Zhang +7

Depth-wise pruning accelerates LLM inference in resource-constrained scenarios but suffers from performance degradation due to direct removal of entire Transformer layers. This pap…