SARATHI: Decoupled Data-Free Probing and Adaptive Reconstruction for Structured LLM Pruning

Sankar Behera, Dhruv Singh, Satyadev Ahlawat +1

Structured pruning reduces the inference cost of large language models (LLMs) by permanently removing neurons and weight rows, yielding dense, hardware-agnostic speedup. Existing p…