59 citations · 116 across the 22 of their papers we have counts for
23 papers
Towards Breaking the Learning System Wall Using Multimodal Tutoring Transcriptions
Danielle R. Thomas, Marie Cynthia Abijuru Kamikazi, Ashish Gurung +5
Past research using log data has faced the "learning system wall," whereby few methods exist for generalizing models of student learning across platforms. Increasingly, online lear…
AI-Driven Assessment of Human Tutors: Linking Training Performance to Real-Life Practice
Danielle R. Thomas, Marie Cynthia Abijuru Kamikazi, Clara Brandt +2
There exist numerous tutor training platforms. However, few provide AI-driven training and evaluation for human tutors based on real-life performance. We present an AI-driven syste…
From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning
Eric S. Qiu, Danielle R. Thomas, Boyuan Guo +2
Sustained effort is essential for realizing the benefits of intelligent tutoring systems (ITS), yet many learners disengage or underuse available practice time. We introduce engage…
Improving Hybrid Human-AI Tutoring by Differentiating Human Tutor Roles Based on Student Needs
Ashish Gurung, Ge Gao, Jordan Gutterman +6
Hybrid human-AI tutoring, where technology and humans jointly facilitate student learning, can be more beneficial than AI-only tutoring. However, preliminary evidence suggests that…
Coasting Through Class: Learning Opportunity Loss from Practice Avoidance During Individual Seatwork
Ashish Gurung, Jordan Gutterman, Danielle R. Thomas +3
Measures of disengagement provide insights into unproductive use of learning opportunities. Although measures of active disengagement, such as gaming the system and mind-wandering,…
Does the TalkMoves Codebook Generalize to One-on-One Tutoring and Multimodal Interaction?
Corina Luca Focsan, Marie Cynthia Abijuru Kamikazi, Tamisha Thompson +5
Accountable Talk theory has been widely adopted to analyze classroom discourse and is increasingly used to annotate tutoring interactions. In particular, the TalkMoves codebook, gr…
Modernizing Ground Truth: Four Shifts Toward Improving Reliability and Validity in AI in Education
Danielle R. Thomas, Conrad Borchers, Kirk P. Vanacore +2
Generative Artificial Intelligence (GenAI) is now widespread in education, yet the efficacy of GenAI systems remains constrained by the quality and interpretation of the labeled da…
Brief but Impactful: How Human Tutoring Interactions Shape Engagement in Online Learning
Conrad Borchers, Ashish Gurung, Qinyi Liu +3
Learning analytics can guide human tutors to efficiently address motivational barriers to learning that AI systems struggle to support. Students become more engaged when they recei…
Beyond Agreement: Rethinking Ground Truth in Educational AI Annotation
Danielle R. Thomas, Conrad Borchers, Kenneth R. Koedinger
Humans can be notoriously imperfect evaluators. They are often biased, unreliable, and unfit to define "ground truth." Yet, given the surging need to produce large amounts of train…
Leveraging LLMs to Assess Tutor Moves in Real-Life Dialogues: A Feasibility Study
Danielle R. Thomas, Conrad Borchers, Jionghao Lin +6
Tutoring improves student achievement, but identifying and studying what tutoring actions are most associated with student learning at scale based on audio transcriptions is an ope…
Detecting LLM-Generated Short Answers and Effects on Learner Performance
Shambhavi Bhushan, Danielle R Thomas, Conrad Borchers +5
The increasing availability of large language models (LLMs) has raised concerns about their potential misuse in online learning. While tools for detecting LLM-generated text exist…
LLM-Generated Feedback Supports Learning If Learners Choose to Use It
Danielle R. Thomas, Conrad Borchers, Shambhavi Bhushan +3
Large language models (LLMs) are increasingly used to generate feedback, yet their impact on learning remains underexplored, especially compared to existing feedback methods. This…
Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment
Conrad Borchers, Danielle R. Thomas, Jionghao Lin +2
Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of…
Comparing Few-Shot Prompting of GPT-4 LLMs with BERT Classifiers for Open-Response Assessment in Tutor Equity Training
Sanjit Kakarla, Conrad Borchers, Danielle Thomas +2
Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of conte…
Do Tutors Learn from Equity Training and Can Generative AI Assess It?
Danielle R. Thomas, Conrad Borchers, Sanjit Kakarla +5
Equity is a core concern of learning analytics. However, applications that teach and assess equity skills, particularly at scale are lacking, often due to barriers in evaluating la…
Does Multiple Choice Have a Future in the Age of Generative AI? A Posttest-only RCT
Danielle R. Thomas, Conrad Borchers, Sanjit Kakarla +5
The role of multiple-choice questions (MCQs) as effective learning tools has been debated in past research. While MCQs are widely used due to their ease in grading, open response q…
How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses
Jionghao Lin, Zifei Han, Danielle R. Thomas +4
One-on-one tutoring is widely acknowledged as an effective instructional method, conditioned on qualified tutors. However, the high demand for qualified tutors remains a challenge,…
How Can I Improve? Using GPT to Highlight the Desired and Undesired Parts of Open-ended Responses
Jionghao Lin, Eason Chen, Zeifei Han +5
Automated explanatory feedback systems play a crucial role in facilitating learning for a large cohort of learners by offering feedback that incorporates explanations, significantl…
Improving Assessment of Tutoring Practices using Retrieval-Augmented Generation
Zifei FeiFei Han, Jionghao Lin, Ashish Gurung +5
One-on-one tutoring is an effective instructional method for enhancing learning, yet its efficacy hinges on tutor competencies. Novice math tutors often prioritize content-specific…
Using Large Language Models to Assess Tutors' Performance in Reacting to Students Making Math Errors
Sanjit Kakarla, Danielle Thomas, Jionghao Lin +2
Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors…
Improving Student Learning with Hybrid Human-AI Tutoring: A Three-Study Quasi-Experimental Investigation
Danielle R. Thomas, Jionghao Lin, Erin Gatz +8
Artificial intelligence (AI) applications to support human tutoring have potential to significantly improve learning outcomes, but engagement issues persist, especially among stude…
Comparative Analysis of GPT-4 and Human Graders in Evaluating Praise Given to Students in Synthetic Dialogues
Dollaya Hirunyasiri, Danielle R. Thomas, Jionghao Lin +2
Research suggests that providing specific and timely feedback to human tutors enhances their performance. However, it presents challenges due to the time-consuming nature of assess…
Using Large Language Models to Provide Explanatory Feedback to Human Tutors
Jionghao Lin, Danielle R. Thomas, Feifei Han +4
Research demonstrates learners engaging in the process of producing explanations to support their reasoning, can have a positive impact on learning. However, providing learners rea…