47 citations · 79 across the 10 of their papers we have counts for
11 papers
Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents
Aayush Kumar, Avik Dutta, Sumit Gulwani +3
Plan Modes have become standard features in agentic programming tools, allowing users to gain transparency and control by working with the agent to develop a plan before task execu…
An Experimental Comparison of Cognitive Forcing Functions for Execution Plans in AI-Assisted Writing: Effects On Trust, Overreliance, and Perceived Critical Thinking
Ahana Ghosh, Advait Sarkar, Siân Lindley +1
Generative AI (GenAI) tools improve productivity in knowledge workflows such as writing, but also risk overreliance and reduced critical thinking. Cognitive forcing functions (CFFs…
Leveraging Test Driven Development with Large Language Models for Reliable and Verifiable Spreadsheet Code Generation: A Research Framework
Simon Thorne, Advait Sarkar
Large Language Models (LLMs), such as ChatGPT, are increasingly leveraged for generating both traditional software code and spreadsheet logic. Despite their impressive generative c…
Product Manager Practices for Delegating Work to Generative AI: "Accountability must not be delegated to non-human actors"
Mara Ulloa, Jenna L. Butler, Sankeerti Haniyur +4
Generative AI (GenAI) is changing the nature of knowledge work, particularly for Product Managers (PMs) in software development teams. While much software engineering research has…
Vibe coding: programming through conversation with artificial intelligence
Advait Sarkar, Ian Drosos
We examine "vibe coding": an emerging programming paradigm where developers primarily write code by interacting with code-generating large language models rather than writing code…
"It makes you think": Provocations Help Restore Critical Thinking to AI-Assisted Knowledge Work
Ian Drosos, Advait Sarkar, Xiaotong +2
Recent research suggests that the use of Generative AI tools may result in diminished critical thinking during knowledge work. We study the effect on knowledge work of provocations…
When Copilot Becomes Autopilot: Generative AI's Critical Risk to Knowledge Work and a Critical Solution
Advait Sarkar, Xiaotong, Xu +3
Generative AI, with its tendency to "hallucinate" incorrect results, may pose a risk to knowledge work by introducing errors. On the other hand, it may also provide unprecedented o…
Dynamic Prompt Middleware: Contextual Prompt Refinement Controls for Comprehension Tasks
Ian Drosos, Jack Williams, Advait Sarkar +1
Effective prompting of generative AI is challenging for many users, particularly in expressing context for comprehension tasks such as explaining spreadsheet formulas, Python code,…
Intention Is All You Need
Advait Sarkar
Among the many narratives of the transformative power of Generative AI is one that sees in the world a latent nation of programmers who need to wield nothing but intentions and nat…
Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructions
Bhuvanashree Murugadoss, Christian Poelitz, Ian Drosos +5
LLMs-as-a-judge is a recently popularized method which replaces human judgements in task evaluation (Zheng et al. 2024) with automatic evaluation using LLMs. Due to widespread use…
Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decomposition
Majeed Kazemitabaar, Jack Williams, Ian Drosos +4
LLM-powered tools like ChatGPT Data Analysis, have the potential to help users tackle the challenging task of data analysis programming, which requires expertise in data processing…