33 citations · 64 across the 28 of their papers we have counts for
18 papers · 1 filter
Leveraging Large Language Models for Identifying Knowledge Components
Canwen Wang, Jionghao Lin, Kenneth R. Koedinger
Knowledge Components (KCs) are foundational to adaptive learning systems, but their manual identification by domain experts is a significant bottleneck. While Large Language Models…
Generative AI alone may not be enough: Evaluating AI Support for Learning Mathematical Proof
Eason Chen, Sophia Judicke, Kayla Beigh +16
We evaluate the effectiveness of LLM-Tutor, a large language model (LLM)-powered tutoring system that combines an AI-based proof-review tutor for real-time feedback on proof-writin…
Comparing RAG and GraphRAG for Page-Level Retrieval Question Answering on a Math Textbook
Eason Chen, Chuangji Li, Eric Li +3
Large language models (LLMs) show promise as educational aids but often lack alignment with specific course materials. We investigate Retrieval-Augmented Generation (RAG) and Graph…
AI Knows Best? The Paradox of Expertise, AI-Reliance, and Performance in Educational Tutoring Decision-Making Tasks
Eason Chen, Jeffrey Li, Scarlett Huang +4
We present an empirical study of how both experienced tutors and non-tutors judge the correctness of tutor praise responses under different Artificial Intelligence (AI)-assisted in…
Beyond Agreement: Rethinking Ground Truth in Educational AI Annotation
Danielle R. Thomas, Conrad Borchers, Kenneth R. Koedinger
Humans can be notoriously imperfect evaluators. They are often biased, unreliable, and unfit to define "ground truth." Yet, given the surging need to produce large amounts of train…
Leveraging LLMs to Assess Tutor Moves in Real-Life Dialogues: A Feasibility Study
Danielle R. Thomas, Conrad Borchers, Jionghao Lin +6
Tutoring improves student achievement, but identifying and studying what tutoring actions are most associated with student learning at scale based on audio transcriptions is an ope…
Automatic Large Language Models Creation of Interactive Learning Lessons
Jionghao Lin, Jiarui Rao, Yiyang Zhao +6
We explore the automatic generation of interactive, scenario-based lessons designed to train novice human tutors who teach middle school mathematics online. Employing prompt engine…
Detecting LLM-Generated Short Answers and Effects on Learner Performance
Shambhavi Bhushan, Danielle R Thomas, Conrad Borchers +5
The increasing availability of large language models (LLMs) has raised concerns about their potential misuse in online learning. While tools for detecting LLM-generated text exist…
LLM-Generated Feedback Supports Learning If Learners Choose to Use It
Danielle R. Thomas, Conrad Borchers, Shambhavi Bhushan +3
Large language models (LLMs) are increasingly used to generate feedback, yet their impact on learning remains underexplored, especially compared to existing feedback methods. This…
Starting Seatwork Earlier as a Valid Measure of Student Engagement
Ashish Gurung, Jionghao Lin, Zhongtian Huang +4
Prior work has developed a range of automated measures ("detectors") of student self-regulation and engagement from student log data. These measures have been successfully used to…
VTutor for High-Impact Tutoring at Scale: Managing Engagement and Real-Time Multi-Screen Monitoring with P2P Connections
Eason Chen, Xinyi Tang, Aprille Xi +5
Hybrid tutoring, where a human tutor supports multiple students in learning with educational technology, is an increasingly common application to deliver high-impact tutoring at sc…
VTutor: An Animated Pedagogical Agent SDK that Provide Real Time Multi-Model Feedback
Eason Chen, Chenyu Lin, Yu-Kai Huang +4
Pedagogical Agents (PAs) show significant potential for boosting student engagement and learning outcomes by providing adaptive, on-demand support in educational contexts. However,…
From First Draft to Final Insight: A Multi-Agent Approach for Feedback Generation
Jie Cao, Chloe Qianhui Zhao, Xian Chen +4
Producing large volumes of high-quality, timely feedback poses significant challenges to instructors. To address this issue, automation technologies-particularly Large Language Mod…
SlideItRight: Using AI to Find Relevant Slides and Provide Feedback for Open-Ended Questions
Chloe Qianhui Zhao, Jie Cao, Eason Chen +2
Feedback is important in supporting student learning. While various automated feedback systems have been implemented to make the feedback scalable, many existing solutions only foc…
Toward Automated Qualitative Analysis: Leveraging Large Language Models for Tutoring Dialogue Evaluation
Megan Gu, Chloe Qianhui Zhao, Claire Liu +4
Our study introduces an automated system leveraging large language models (LLMs) to assess the effectiveness of five key tutoring strategies: 1. giving effective praise, 2. reactin…
VTutor: An Open-Source SDK for Generative AI-Powered Animated Pedagogical Agents with Multi-Media Output
Eason Chen, Chenyu Lin, Xinyi Tang +4
The rapid evolution of large language models (LLMs) has transformed human-computer interaction (HCI), but the interaction with LLMs is currently mainly focused on text-based intera…
Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment
Conrad Borchers, Danielle R. Thomas, Jionghao Lin +2
Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of…
Comparing Few-Shot Prompting of GPT-4 LLMs with BERT Classifiers for Open-Response Assessment in Tutor Equity Training
Sanjit Kakarla, Conrad Borchers, Danielle Thomas +2
Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of conte…