Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Sample Complexity of Multicalibration for Multilevel Properties
Jiuyao Lu, Krishnakumar Balasubramanian, Aleksandr Podkopaev +1
Calibration requires a predictor to be unbiased after conditioning on its own predictions. Multicalibration asks for this guarantee simultaneously across a collection of groups. Ma…
stat.ML2026
Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models
Krishnakumar Balasubramanian, Aleksandr Podkopaev, Shiva Prasad Kasiviswanathan
Large-scale AI evaluation increasingly relies on aggregating binary judgments from annotators, including LLMs used as judges. Most classical methods, e.g., Dawid-Skene or (weig…