Task-Aware LoRA Adapter Composition via Similarity Retrieval in Vector Databases

Riya Adsul, Balachandra Devarangadi Sunil, Isha Nalawade +1

Parameter efficient fine tuning methods like LoRA have enabled task specific adaptation of large language models, but efficiently composing multiple specialized adapters for unseen…