Not All Layers of LLMs Are Necessary During Inference

Siqi Fan, Xin Jiang, Xiang Li +6

Due to the large number of parameters, the inference phase of Large Language Models (LLMs) is resource-intensive. However, not all requests posed to LLMs are equally difficult to h…