Building a Nested LADDER for LLM Unstructured Post-Training Pruning

Nicolás Mauricio Cuadrado Ávila, Ivo Gollini Navarrete, Martin Takáč +1

Non-uniform allocation can improve post-training pruning of large language models, yet quality can still degrade sharply at high sparsity. To control degradation as sparsity increa…