Repair Changes Which Layers to Remove: Exact Optima for Depth Pruning of Language Models

Jianchang Su, Dawei Xiang, Yifan Zhang +1

Depth pruning removes entire transformer layers to make large language models faster, and recent methods recover quality by replacing the removed layers with a training-free linear…