10 citations · 15 across the 11 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
A Framework for Evaluating LLMs Under Task Indeterminacy
Luke Guerdan, Hanna Wallach, Solon Barocas +1
Large language model (LLM) evaluations often assume there is a single correct response -- a gold label -- for each item in the evaluation corpus. However, some tasks can be ambiguo…
cs.LG2024
Predictive Performance Comparison of Decision Policies Under Confounding
Luke Guerdan, Amanda Coston, Kenneth Holstein +1
Predictive models are often introduced to decision-making tasks under the rationale that they improve performance over an existing decision-making policy. However, it is challengin…