Auditing Conformal Prediction for Language Models Under Inference-Time Model Shift

Achref Doula, Max Mühlhäuser

Conformal prediction (CP) for language models is typically evaluated under a matched protocol, in which calibration and deployment use the same post-training inference configuratio…