Exploring the Limits of Pruning: Task-Specific Neurons, Model Collapse, and Recovery in Task-Specific Large Language Models

M. K. Khalidi Siam, Md. Tausif-Ul-Islam, Md. Reshad Romim Khan +5

Neuron pruning is widely used to reduce the computational cost and parameter footprint of large language models, yet it remains unclear whether neurons in task-specific models cont…