83 citations · 332 across the 12 of their papers we have counts for
4 papers · 1 filter
An In-depth Look at Gemini's Language Abilities
Syeda Nahida Akter, Zichun Yu, Aashiq Muhamed +6
The recently released Google Gemini class of models are the first to comprehensively report results that rival the OpenAI GPT series across a wide variety of tasks. In this paper,…
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms
Nari Johnson, Ángel Alexander Cabrera, Gregory Plumb +1
Machine learning (ML) models that achieve high average accuracy can still underperform on semantically coherent subsets ("slices") of data. This behavior can have significant socie…
Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning
Ángel Alexander Cabrera, Erica Fu, Donald Bertucci +4
Machine learning models with high accuracy on test data can still produce systematic failures, such as harmful biases and safety issues, when deployed in the real world. To detect…
Improving Human-AI Collaboration With Descriptions of AI Behavior
Ángel Alexander Cabrera, Adam Perer, Jason I. Hong
People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appr…