ServerlessLoRA: Enabling Low-Latency Serverless Multi-LoRA Serving

Yifan Sui, Hao Wang, Hanfei Yu +5

Multi-LoRA (Low-Rank Adaptation) serving allows many specialized LLM variants to share the same base model by attaching lightweight adapters. This makes it attractive for serving l…