1 paper
Zecheng Zhang, Han Zheng, Yue Xu
Evaluating production LLM responses and routing requests across providers in LLM gateways requires fine-grained quality signals and operationally grounded decisions. To address thi…