7 papers
Conformal Prediction under Partial Verification
Zijun Yu, Yu Gu, Vahid Partovi Nia +1
Conformal prediction provides prediction sets with finite-sample guarantees, but the label verification required for calibration can be expensive. We develop a partial verification…
G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harm
Zijun Yu, Yu Gu, Vahid Partovi Nia +1
Small language model (SLM) agents need safety controls that track consequences across tool calls with little monitoring overhead. A private read, for example, becomes a leak when a…
On the Burden of Achieving Fairness in Conformal Prediction
Ziang Gao, Pengqi Liu, Archer Yi Yang +3
Conformal prediction is often calibrated with a single pooled threshold, but this can hide cross-group heterogeneity in score distributions and distort group-wise coverage. We stud…
Pause and Reflect: Conformal Aggregation for Chain-of-Thought Reasoning
Yu Gu, Zijun Yu, Vahid Partovi Nia +1
Chain-of-thought (CoT) reasoning with self-consistency improves performance by aggregating multiple sampled reasoning paths. In this setting, correctness is no longer tied to a sin…
Beyond Procedure: Substantive Fairness in Conformal Prediction
Pengqi Liu, Zijun Yu, Mouloud Belbahri +3
Conformal prediction (CP) offers distribution-free uncertainty quantification for machine learning models, yet its interplay with fairness in downstream decision-making remains und…
Detection of Multiple Influential Observations on Model Selection
Dongliang Zhang, Masoud Asgharian, Martin A. Lindquist
Outlying observations are frequently encountered across a wide spectrum of scientific domains, posing notable challenges to the generalizability of statistical models and the repro…
Assessing Influential Observations in Pain Prediction using fMRI Data
Dongliang Zhang, Masoud Asgharian, Martin A. Lindquist
Neuroimaging data allows researchers to model the relationship between multivariate patterns of brain activity and outcomes related to mental states and behaviors. However, the exi…