SureMap: Simultaneous Mean Estimation for Single-Task and Multi-Task Disaggregated Evaluation

Mikhail Khodak, Lester Mackey, Alexandra Chouldechova +1

Disaggregated evaluation -- estimation of performance of a machine learning model on different subpopulations -- is a core task when assessing performance and group-fairness of AI…