3 citations · 5 across the 15 of their papers we have counts for
5 papers · 1 filter
CalArena: A Large-Scale Post-Hoc Calibration Benchmark
Eugène Berta, David Holzmüller, Francis Bach +1
Reliable probability estimates are critical in many machine learning applications, yet modern classifiers are often poorly calibrated. Post-hoc calibration provides a simple and wi…
Super-Level-Set Regression: Conditional Quantiles via Volume Minimization
Sacha Braun, Michael I. Jordan, Francis Bach
Constructing minimum-volume prediction regions that satisfy conditional coverage is a fundamental challenge in multivariate regression. Standard approaches rely on explicitly estim…
Explaining and Preventing Alignment Collapse in Iterative RLHF
Etienne Gauthier, Francis Bach, Michael I. Jordan
Reinforcement learning from human feedback (RLHF) typically assumes a static or non-strategic reward model (RM). In iterative deployment, however, the policy generates the data on…
V-ECE: Estimating General Expected Calibration Errors
Eugène Berta, Sacha Braun, David Holzmüller +2
In probabilistic classification, calibration error (CE) measures the average divergence of predicted probabilities from , the true class distribution for…
Anytime Detection of Strategic Deviations in Multi-Agent Systems
Etienne Gauthier, Francis Bach, Michael I. Jordan
In many multi-agent systems, agents interact repeatedly and are expected to settle into stable, rational behavior over time. Yet in practice, behavior often drifts, and detecting s…