SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained Large Language Models

Samir Arora, Liangliang Wang

Full fine-tuning is a popular approach to adapt Transformer-based pre-trained large language models to a specific downstream task. However, the substantial requirements for computa…