6 papers
Eigenvalue Calibration for Semantic Embeddings of Large Language Models
Sebastian G. Gruber, Nassim Walha, Francis Bach +1
Uncertainty quantification is central to the reliable deployment of large language models (LLMs), and eigenvalues of semantic embeddings have recently emerged as a key tool in stat…
Fine-Grained Uncertainty Decomposition in Large Language Models: A Spectral Approach
Nassim Walha, Sebastian G. Gruber, Thomas Decker +4
As Large Language Models (LLMs) are increasingly integrated in diverse applications, obtaining reliable measures of their predictive uncertainty has become critically important. A…
A Novel Framework for Uncertainty Quantification via Proper Scores for Classification and Beyond
Sebastian G. Gruber
In this PhD thesis, we propose a novel framework for uncertainty quantification in machine learning, which is based on proper scores. Uncertainty quantification is an important cor…
CARE: Confidence-aware Ratio Estimation for Medical Biomarkers
Jiameng Li, Teodora Popordanoska, Aleksei Tiulpin +3
Ratio-based biomarkers (RBBs), such as the proportion of necrotic tissue within a tumor, are widely used in clinical practice to support diagnosis, prognosis, and treatment plannin…
Optimizing Estimators of Squared Calibration Errors in Classification
Sebastian G. Gruber, Francis Bach
In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings. Improving t…
Disentangling Mean Embeddings for Better Diagnostics of Image Generators
Sebastian G. Gruber, Pascal Tobias Ziegler, Florian Buettner
The evaluation of image generators remains a challenge due to the limitations of traditional metrics in providing nuanced insights into specific image regions. This is a critical p…