5 papers
Audited Conformal Prediction for Classification under Unknown Distribution Shift
Yanfei Zhou, Rizal Fathony, Nam H. Nguyen +1
We consider the problem of uncertainty quantification for a pretrained classification model deployed under unknown distribution shift. We propose Audited Conformal Prediction (ACP)…
Are LLM Decisions Faithful to Verbal Confidence?
Jiawei Wang, Yanfei Zhou, Siddartha Devic +1
Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied…
Conformal Inference for Open-Set and Imbalanced Classification
Tianmin Xie, Yanfei Zhou, Ziyi Liang +2
This paper presents a conformal prediction method for classification in highly imbalanced and open-set settings, where there are many possible classes and not all may be represente…
Conformal Classification with Equalized Coverage for Adaptively Selected Groups
Yanfei Zhou, Matteo Sesia
This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen feat…
Conformalized Adaptive Forecasting of Heterogeneous Trajectories
Yanfei Zhou, Lars Lindemann, Matteo Sesia
This paper presents a new conformal method for generating simultaneous forecasting bands guaranteed to cover the entire path of a new random trajectory with sufficiently high proba…