55 citations · 105 across the 16 of their papers we have counts for
22 papers
Improved Confidence Estimates for Black-Box Large Language Models
Sokhna Diarra Mbacke, Mouloud Belbahri, Gabriel Loaiza-Ganem
Uncertainty quantification (UQ) is essential for the safe deployment of large language models (LLMs). Existing methods, from verbalized confidence to ones requiring multiple genera…
Conf-Gen: Conformal Uncertainty Quantification for Generative Models
Gabriel Loaiza-Ganem, Kevin Zhang, Wei Cui +2
Conformal prediction (CP) and its extension, conformal risk control (CRC), are established frameworks for quantifying uncertainty in supervised machine learning through formal guar…
On Convolutions, Intrinsic Dimension, and Diffusion Models
Kin Kwan Leung, Rasa Hosseinzadeh, Gabriel Loaiza-Ganem
The manifold hypothesis asserts that data of interest in high-dimensional ambient spaces, such as image data, lies on unknown low-dimensional submanifolds. Diffusion models (DMs) -…
Textual Bayes: Quantifying Prompt Uncertainty in LLM-Based Systems
Brendan Leigh Ross, Noël Vouitsis, Atiyeh Ashari Ghomi +8
Although large language models (LLMs) are becoming increasingly capable of solving challenging real-world tasks, accurately quantifying their uncertainty remains a critical open pr…
Last Layer Empirical Bayes
Valentin Villecroze, Yixin Wang, Gabriel Loaiza-Ganem
The task of quantifying the inherent uncertainty associated with neural network predictions is a key challenge in artificial intelligence. Bayesian neural networks (BNNs) and deep…
Deep Ensembles Secretly Perform Empirical Bayes
Gabriel Loaiza-Ganem, Valentin Villecroze, Yixin Wang
Quantifying uncertainty in neural networks is a highly relevant problem which is essential to many applications. The two predominant paradigms to tackle this task are Bayesian neur…