7 papers
How AI Assistance Affects Human Skill Development: A Study of Learning with Logic Puzzles
Shang Wu, Catarina G Belem, Shuyuan Fu +2
While AI assistance can improve human task performance in the short term, it may also undermine the development of skills in the longer term. We examine this tension in a controlle…
Generalization of Fine-Tuned Uncertainty Communication and Metacognition in Large Language Models
Mark Steyvers, Catarina Belem, Padhraic Smyth
Background. Large language models are increasingly used in settings where confident but incorrect answers can mislead users. Reliable uncertainty communication requires a form of m…
From `May' to `Is': Certainty Distortion in Language Model Rewriting
Catarina G Belem, Shang Wu, Hongyu Yao +3
Humans increasingly turn to Language Models (LMs) in ways that shape beliefs and drive decisions, including discussing, rewriting, and summarizing information from scientific artic…
The Impact of AI Usage and Informativeness on Skill Development in Logical Reasoning
Shang Wu, Hongyu Yao, Catarina Belem +3
Artificial intelligence (AI) is being increasingly integrated into human problem-solving, yet its effects on individual skill development remain unclear. We examine how both AI usa…
Semantic Probabilistic Control of Language Models
Kareem Ahmed, Catarina G Belem, Padhraic Smyth +1
Semantic control entails steering LM generations towards satisfying subtle non-lexical constraints, e.g., toxicity, sentiment, or politeness, attributes that can be captured by a s…
What Large Language Models Know and What People Think They Know
Mark Steyvers, Heliodoro Tejeda, Aakriti Kumar +5
As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their output…