More AI Assistance Reduces Cognitive Engagement: Examining the AI Assistance Dilemma in AI-Supported Note-Taking

Abstract

As AI tools become increasingly embedded in cognitively demanding tasks such as note-taking, questions remain about whether they enhance or undermine cognitive engagement. This paper examines the "AI Assistance Dilemma" in note-taking, investigating how varying levels of AI support affect user engagement and comprehension. In a within-subject experiment, we asked participants (N=30) to take notes during lecture videos under three conditions: Automated AI (high assistance with structured notes), Intermediate AI (moderate assistance with real-time summary, and Minimal AI (low assistance with transcript). Results reveal that Intermediate AI yields the highest post-test scores and Automated AI the lowest. Participants, however, preferred the automated setup due to its perceived ease of use and lower cognitive effort, suggesting a discrepancy between preferred convenience and cognitive benefits. Our study provides insights into designing AI assistance that preserves cognitive engagement, offering implications for designing moderate AI support in cognitive tasks.

Accepted by CSCW2025

References in corpus (5)

• Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
• Are We On Track? AI-Assisted Active and Passive Goal Reflection During Meetings
• MeetMap: Real-Time Collaborative Dialogue Mapping with LLMs in Online Meetings
• AutoScrum: Automating Project Planning Using Large Language Models
• What Does Success Look Like? Catalyzing Meeting Intentionality with AI-Assisted Prospective Reflection