Layer-wise Curriculum Learning for Efficient LLM Compression

Donggeon Lee, Dooyeon Na, Seungmin Oh +1

In this paper, we introduce layer-wise curriculum learning for efficient LLM compression. The proposed method facilitates the knowledge transfer from the teacher model to the stude…