MeTA-LoRA: Data-Efficient Multi-Task Fine-Tuning for Large Language Models

Bo Cheng, Xu Wang, Jinda Liu +2

Low-Rank Adaptation (LoRA) has emerged as one of the most widely used parameter-efficient fine-tuning (PEFT) methods for adapting large language models (LLMs) to downstream tasks.…