4 papers
On Continuous Monitoring of Risk Violations under Unknown Shift
Alexander Timans, Rajeev Verma, Eric Nalisnick +1
Machine learning systems deployed in the real world must operate under dynamic and often unpredictable distribution shifts. This challenges the validity of statistical safety assur…
Read Your Own Mind: Reasoning Helps Surface Self-Confidence Signals in LLMs
Jakub Podolak, Rajeev Verma
We study the source of uncertainty in DeepSeek R1-32B by analyzing its self-reported verbal confidence on question answering (QA) tasks. In the default answer-then-confidence setti…
On Calibration in Multi-Distribution Learning
Rajeev Verma, Volker Fischer, Eric Nalisnick
Modern challenges of robustness, fairness, and decision-making in machine learning have led to the formulation of multi-distribution learning (MDL) frameworks in which a predictor…
An AI aid to the editors. Exploring the possibility of an AI assisted article classification system
Tirthankar Ghosal, Rajeev Verma, Asif Ekbal +2
This work is a preliminary exploratory study of how we could progress a step towards an AI assisted article classification sys- tem in academia. The proposed system aims to aid the…