SAPE: Sandwich Adapters for Parameter Efficiency in Large Language Model Fine-Tuning

Mohammad Aref Jafari-Raddani, Morteza Mohajjel Kafshdooz

While Parameter-Efficient Fine-Tuning (PEFT) has substantially reduced the hardware cost of adapting Large Language Models (LLMs) by decreasing the number of trainable parameters,…