Compositional Conformal Risk Control for Multi-Stage LLM Cascades

Yuxia Sun, Jiahuang Wang, Haoting Liu +3

Multi-stage large language model (LLM) cascades balance accuracy and inference cost, but reliable deployment also requires controlling error risk and identifying its sources across…