Chance-Constrained Personalized LLM Routing with Online Preference Learning

Ameya Anjarlekar, Rasoul Etesami, R Srikant

We study personalized LLM routing, where a router selects among heterogeneous models with different costs and capabilities. The router must minimize cumulative inference cost while…