1 paper · 1 filter
Warren Johnson, Charles Lee
Selecting the appropriate model at inference time -- the routing problem -- requires jointly optimizing output quality, cost, latency, and governance constraints. Existing approach…