3 papers · 1 filter
Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models
Krishnakumar Balasubramanian, Aleksandr Podkopaev, Shiva Prasad Kasiviswanathan
Large-scale AI evaluation increasingly relies on aggregating binary judgments from annotators, including LLMs used as judges. Most classical methods, e.g., Dawid-Skene or (weig…
Sequential Kernelized Independence Testing
Aleksandr Podkopaev, Patrick Blöbaum, Shiva Prasad Kasiviswanathan +1
Independence testing is a classical statistical problem that has been extensively studied in the batch setting when one fixes the sample size before collecting data. However, pract…
Modeling Causal Mechanisms with Diffusion Models for Interventional and Counterfactual Queries
Patrick Chao, Patrick Blöbaum, Sapan Patel +1
We consider the problem of answering observational, interventional, and counterfactual queries in a causally sufficient setting where only observational data and the causal graph a…