A deeper look at depth pruning of LLMs

Shoaib Ahmed Siddiqui, Xin Dong, Greg Heinrich +4

Large Language Models (LLMs) are not only resource-intensive to train but even more costly to deploy in production. Therefore, recent work has attempted to prune blocks of LLMs bas…