182 citations · 375 across the 26 of their papers we have counts for
6 papers · 1 filter
Generalization of Fine-Tuned Uncertainty Communication and Metacognition in Large Language Models
Mark Steyvers, Catarina Belem, Padhraic Smyth
Background. Large language models are increasingly used in settings where confident but incorrect answers can mislead users. Reliable uncertainty communication requires a form of m…
Beyond Accuracy: How AI Metacognitive Sensitivity improves AI-assisted Decision Making
ZhaoBin Li, Mark Steyvers
In settings where human decision-making relies on AI input, both the predictive accuracy of the AI system and the reliability of its confidence estimates influence decision quality…
When not to help: planning for lasting human-AI collaboration
Mark Steyvers, Lukas Mayer
AI systems and technologies that can interact with humans in real time face a communication dilemma: when to offer assistance and how frequently. Overly frequent or contextually re…
Bayesian Inference for Correlated Human Experts and Classifiers
Markelle Kelly, Alex Boyd, Sam Showalter +2
Applications of machine learning often involve making predictions based on both model outputs and the opinions of human experts. In this context, we investigate the problem of quer…
Metacognition and Uncertainty Communication in Humans and Large Language Models
Mark Steyvers, Megan A. K. Peters
Metacognition--the capacity to monitor and evaluate one's own knowledge and performance--is foundational to human decision-making, learning, and communication. As large language mo…
Human-AI Collaboration: Trade-offs Between Performance and Preferences
Lukas William Mayer, Sheer Karny, Jackie Ayoub +4
Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systemati…