1 citations · 2 across the 11 of their papers we have counts for
7 papers · 1 filter
Evaluating and Recalibrating Probabilistic Classifiers from One-Bit Threshold Queries
Roman Plaud, Antoine Saillenfest, Matthieu Labeau +2
Standard calibration evaluation and recalibration methods assume access to predicted probabilities. We study one-bit threshold access, a setting in which probabilities are hidden a…
Evaluating Epistemic Uncertainty: Beyond OOD Detection and Active Learning
Jakub Paplhám, Willem Waegeman, Eyke Hüllermeier +1
Current evaluation of epistemic uncertainty relies on tasks such as out-ofdistribution detection and active learning. However, the Bayes-optimal decision strategies for these tasks…
When should we trust the annotation? Selective prediction for molecular structure retrieval from mass spectra
Mira Jürgens, Gaetan De Waele, Morteza Rakhshaninejad +1
Machine learning methods for identifying molecular structures from tandem mass spectra (MS/MS) have advanced rapidly, yet current approaches still exhibit significant error rates.…
Conformal Prediction for Uncertainty Estimation in Drug-Target Interaction Prediction
Morteza Rakhshaninejad, Mira Jurgens, Nicolas Dewolf +1
Accurate drug-target interaction (DTI) prediction with machine learning models is essential for drug discovery. Such models should also provide a credible representation of their u…
Position: Epistemic uncertainty estimation methods are fundamentally incomplete
Sebastián Jiménez, Mira Jürgens, Willem Waegeman
Identifying and disentangling sources of predictive uncertainty is essential for trustworthy supervised learning. We argue that widely used second-order methods that disentangle al…
A calibration test for evaluating set-based epistemic uncertainty representations
Mira Jürgens, Thomas Mortier, Eyke Hüllermeier +2
The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilist…
Reducing Aleatoric and Epistemic Uncertainty through Multi-modal Data Acquisition
Arthur Hoarau, Benjamin Quost, Sébastien Destercke +1
To generate accurate and reliable predictions, modern AI systems need to combine data from multiple modalities, such as text, images, audio, spreadsheets, and time series. Multi-mo…