1 paper
Haochun Tang, Yuliang Yan, Jiahua Lu +2
Cost-aware routing dynamically dispatches user queries to models of varying capability to balance performance and inference cost. However, the routing strategy introduces a new sec…