Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Deterministic Inference across Tensor Parallel Sizes That Eliminates Training-Inference Mismatch
Ziyang Zhang, Xinheng Ding, Jiayi Yuan +4
Deterministic inference is increasingly critical for large language model (LLM) applications such as LLM-as-a-judge evaluation, multi-agent systems, and Reinforcement Learning (RL)…
cs.LG2025★ 1 cited
RouterArena: An Open Platform for Comprehensive Comparison of LLM Routers
Yifan Lu, Rixin Liu, Jiayi Yuan +4
Today's LLM ecosystem comprises a wide spectrum of models that differ in size, capability, and cost. No single model is optimal for all scenarios; hence, LLM routers have become es…