3 papers
cs.LG2026
Deterministic Inference across Tensor Parallel Sizes That Eliminates Training-Inference Mismatch
Ziyang Zhang, Xinheng Ding, Jiayi Yuan +4
Deterministic inference is increasingly critical for large language model (LLM) applications such as LLM-as-a-judge evaluation, multi-agent systems, and Reinforcement Learning (RL)…
cs.DC2026
Characterization-Guided GPU Fault Resilience in NVIDIA MPS
Rixin Liu, Xingqi Cui, Kaijian Wang +4
NVIDIA Multi-Process Service (MPS) enables fine-grained GPU sharing by allowing multiple processes to execute concurrently on the same GPU, making it an important mechanism for imp…
cs.LG2025
RouterArena: An Open Platform for Comprehensive Comparison of LLM Routers
Yifan Lu, Rixin Liu, Jiayi Yuan +4
Today's LLM ecosystem comprises a wide spectrum of models that differ in size, capability, and cost. No single model is optimal for all scenarios; hence, LLM routers have become es…