Belief-Guided Inference Control for Large Language Model Services via Verifiable Observations

Wenhao Yuan, Chenchen Lin, Jian Chen +3

In black-box large language model (LLM) services, response reliability is often only partially observable at decision time, while stronger inference pathways incur substantial comp…