2 citations · 3 across the 7 of their papers we have counts for
9 papers
Learning Checklists to Reduce Lottery Effects in Scientific Peer Review
Xuanyou Liu, Ziyang Guo, Jason Hartline +1
Reviewer lottery error describes error due to a small set of peer reviews attending to only some of the issues with a paper that a larger pool of eligible reviewers would raise. We…
Calibrating LLM Explanations to Human Decisions with Reinforcement Learning
Dong Shu, Ziyang Guo, Negar Kamali +2
Explanations of LLM outputs are considered an important way to make model behavior legible, helping human users make good decisions on downstream tasks. However, default training a…
ComplLLM: Fine-tuning LLMs to Discover Complementary Signals for Decision-making
Ziyang Guo, Yifan Wu, Jason Hartline +2
Multi-agent decision pipelines can outperform single agent workflows when complementarity holds, i.e., different agents bring unique information to the table to inform a final deci…
Explanations are a Means to an End: Decision Theoretic Explanation Evaluation
Ziyang Guo, Berk Ustun, Jessica Hullman
Explanations of model behavior are commonly evaluated via proxy properties weakly tied to the purposes explanations serve in practice. We contribute a decision theoretic framework…
Conformal Prediction and Human Decision Making
Jessica Hullman, Yifan Wu, Dawei Xie +2
Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular m…
Explaining and Improving Information Complementarities in Multi-Agent Decision-making
Ziyang Guo, Yifan Wu, Jason Hartline +1
Multiple agents are increasingly combined to make decisions with the expectation of achieving complementary performance, where the decisions they make together outperform those mad…
Unexploited Information Value in Human-AI Collaboration
Ziyang Guo, Yifan Wu, Jason Hartline +1
Humans and AIs are often paired on decision tasks with the expectation of achieving complementary performance -- where the combination of human and AI outperforms either one alone.…
VMC: A Grammar for Visualizing Statistical Model Checks
Ziyang Guo, Alex Kale, Matthew Kay +1
Visualizations play a critical role in validating and improving statistical models. However, the design space of model check visualizations is not well understood, making it diffic…
A Decision Theoretic Framework for Measuring AI Reliance
Ziyang Guo, Yifan Wu, Jason Hartline +1
Humans frequently make decisions with the aid of artificially intelligent (AI) systems. A common pattern is for the AI to recommend an action to the human who retains control over…