Is Escalation Worth It? A Decision-Theoretic Characterization of LLM Cascades

Dylan Bouchard

Model cascades, in which a cheap LLM defers to an expensive one on low-confidence queries, are widely used to navigate the cost-quality tradeoff at deployment. Existing approaches…