In-Context Meta LoRA Generation

Yihua Shao, Minxi Yan, Yang Liu +12

Low-rank Adaptation (LoRA) has demonstrated remarkable capabilities for task specific fine-tuning. However, in scenarios that involve multiple tasks, training a separate LoRA model…