98 citations · 379 across the 33 of their papers we have counts for
14 papers · 1 filter
Mitigating LLM Hallucinations via Conformal Abstention
Yasin Abbasi Yadkori, Ilja Kuzborskij, David Stutz +9
We develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of…
Conformal prediction under ambiguous ground truth
David Stutz, Abhijit Guha Roy, Tatiana Matejovicova +3
Conformal Prediction (CP) allows to perform rigorous uncertainty quantification by constructing a prediction set satisfying for a user-chose…
Evaluating AI systems under uncertain ground truth: a case study in dermatology
David Stutz, Ali Taylan Cemgil, Abhijit Guha Roy +17
For safety, medical AI systems undergo thorough evaluations before deployment, validating their predictions against a ground truth which is assumed to be fixed and certain. However…
Transformers Meet Directed Graphs
Simon Geisler, Yujia Li, Daniel Mankowitz +3
Transformers were originally proposed as a sequence-to-sequence model for text but have become vital for a wide range of modalities, including images, audio, video, and undirected…
An Indoor Localization Dataset and Data Collection Framework with High Precision Position Annotation
F. Serhan Daniş, A. Teoman Naskali, A. Taylan Cemgil +1
We introduce a novel technique and an associated high resolution dataset that aims to precisely evaluate wireless signal based indoor positioning algorithms. The technique implemen…
Evaluating the Adversarial Robustness of Adaptive Test-time Defenses
Francesco Croce, Sven Gowal, Thomas Brunner +3
Adaptive defenses, which optimize at test time, promise to improve adversarial robustness. We categorize such adaptive test-time defenses, explain their potential benefits and draw…