1 paper · 1 filter
Yudong Gao, Linghan Chen, Wenhan Wu +8
LLM gateways enforce separate tenant quotas while sharing model deployments and cooldown records that temporarily exclude failing backends. However, a tenant's request failure can…