Taming Variability: Randomized and Bootstrapped Conformal Risk Control for LLMs

Lingyou Pang, Lei Huang, Jianyu Lin +3

We transform the randomness of LLMs into precise assurances using an actuator at the API interface that applies a user-defined risk constraint in finite samples via Conformal Risk…