4 papers · 1 filter
Agreement Overstates Evidence: Error Dependence in LLM Judge Consensus
Elias Hossain, Niloofar Yousefi, Ser-Nam Lim
Consensus among LLM judges is often taken as strong evidence that a decision is correct. This assumes that judges make their errors independently. In practice, LLM judges are often…
NEXUS: Structured Runtime Safety for Tool-Using LLM Agents
Elias Hossain, Md Mehedi Hasan Nipu, Tasfia Nuzhat Ornee +2
Tool-using LLM agents increasingly execute high-impact actions, making runtime safety monitoring essential. We present NEXUS (Neural EXecution Utility and Safety), a structured-pla…
UAT-LITE: Inference-Time Uncertainty-Aware Attention for Pretrained Transformers
Elias Hossain, Shubhashis Roy Dipta, Subash Neupane +4
Neural NLP models are often miscalibrated and overconfident, assigning high confidence to incorrect predictions and failing to express uncertainty during internal evidence aggregat…
MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Support
Elias Hossain, Md Mehedi Hasan Nipu, Maleeha Sheikh +5
Clinical language models often assign high confidence to incorrect predictions, particularly in high-severity and out-of-distribution cases. We present MedBayes-Lite, a retraining-…