Privacy-Preserving LLMs Routing

Xidong Wu, Yukuan Zhang, Yuqiong Ji +3

Large language model (LLM) routing has emerged as a critical strategy to balance model performance and cost-efficiency by dynamically selecting services from various model provider…