4 papers
Audited Conformal Prediction for Classification under Unknown Distribution Shift
Yanfei Zhou, Rizal Fathony, Nam H. Nguyen +1
We consider the problem of uncertainty quantification for a pretrained classification model deployed under unknown distribution shift. We propose Audited Conformal Prediction (ACP)…
Are LLM Decisions Faithful to Verbal Confidence?
Jiawei Wang, Yanfei Zhou, Siddartha Devic +1
Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied…
Conformal Inference for Open-Set and Imbalanced Classification
Tianmin Xie, Yanfei Zhou, Ziyi Liang +2
This paper presents a conformal prediction method for classification in highly imbalanced and open-set settings, where there are many possible classes and not all may be represente…
Conformal Classification with Equalized Coverage for Adaptively Selected Groups
Yanfei Zhou, Matteo Sesia
This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen feat…