4 papers
Language Models Exhibit Inconsistent Biases Towards Algorithmic Agents and Human Experts
Jessica Y. Bo, Lillio Mok, Ashton Anderson
Large language models are increasingly used in decision-making tasks that require them to process information from a variety of sources, including both human experts and other algo…
Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving Tasks
Jessica Y. Bo, Majeed Kazemitabaar, Mengqing Deng +2
Sycophancy, the tendency of LLM-based chatbots to express excessive agreement with their users, even when inappropriate, is emerging as a significant risk in human-AI interactions.…
Who's the Leader? Analyzing Novice Workflows in LLM-Assisted Debugging of Machine Learning Code
Jessica Y. Bo, Majeed Kazemitabaar, Emma Zhuang +1
While LLMs are often touted as tools for democratizing specialized knowledge to beginners, their actual effectiveness for improving task performance and learning is still an open q…
To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language Models
Jessica Y. Bo, Sophia Wan, Ashton Anderson
As Large Language Models become integral to decision-making, optimism about their power is tempered with concern over their errors. Users may over-rely on LLM advice that is confid…