EBFT: Effective and Block-Wise Fine-Tuning for Sparse LLMs

Song Guo, Fan Wu, Lei Zhang +5

Existing methods for fine-tuning sparse LLMs often suffer from resource-intensive requirements and high retraining costs. Additionally, many fine-tuning methods often rely on appro…