2 papers
cs.NI2026
RouterWise: Joint Resource Allocation and Routing for Latency-Aware Multi-Model LLM Serving
Hossein Hosseini Kasnavieh, Gholamreza Haffari, Christopher Leckie +1
Multi-model LLM routing has emerged as an effective approach for reducing serving cost and latency while maintaining output quality by assigning each prompt to an appropriate model…
cs.CL2026
IntroLM: Introspective Language Models via Prefilling-Time Self-Evaluation
Hossein Hosseini Kasnavieh, Gholamreza Haffari, Chris Leckie +1
A major challenge for the operation of large language models (LLMs) is how to predict whether a specific LLM will produce sufficiently high-quality output for a given query. Existi…