6 papers
A CaLLM Judge is a Better Judge: Mitigating Bias in LLM-as-a-judge
Cesare Barbera, Luca Stradiotti, Lorenzo Cascioli +6
Large language models (LLMs) are increasingly used as judges to predict which of two candidate answers a human evaluator would prefer, providing a scalable alternative when human e…
Should I stay or should I show? Learning to selectively disclose information
Carlotta Giacchetta, Alessando Bogani, Cesare Barbera +4
In many high-stakes settings, human decision-makers can acquire support information before making a decision. However, acquiring information is costly, and disclosure may fail to i…
Divide et Calibra: Multiclass Local Calibration via Vector Quantization
Cesare Barbera, Lorenzo Perini, Giovanni De Toni +2
Accurate and well-calibrated Machine Learning (ML) models are mandatory in high-stakes settings, yet effective multiclass calibration remains challenging: global approaches assume…
To Ask or Not to Ask: Learning to Require Human Feedback
Andrea Pugnana, Giovanni De Toni, Cesare Barbera +3
Developing decision-support systems that complement human performance in classification tasks remains an open challenge. A popular approach, Learning to Defer (LtD), allows a Machi…
Multiclass Local Calibration with the Jensen-Shannon Distance
Cesare Barbera, Lorenzo Perini, Giovanni De Toni +2
Developing trustworthy Machine Learning (ML) models requires their predicted probabilities to be well-calibrated, meaning they should reflect true-class frequencies. Among calibrat…
Zoom In Disparities in Healthcare LLM Q&A
Ipek Baris Schlicht, Burcu Sayin, Zhixue Zhao +5
Equitable access to reliable health information is vital when integrating AI into healthcare. Yet, information quality varies across languages, raising concerns about the reliabili…