1 paper
Zehan Sun, Dingfan Chen, Songze Li
Large Language Model (LLM) cascade systems are designed to balance efficiency and performance by processing queries with lightweight models while selectively escalating complex cas…