Effective LoRA Adapter Routing using Task Representations

Akash Dhasade, Anne-Marie Kermarrec, Igor Pavlovic +4

Low-rank adaptation (LoRA) enables parameter efficient specialization of large language models (LLMs) through modular adapters, resulting in rapidly growing public adapter pools sp…