3 papers
cs.CL2026
Codebook-Injected Dialogue Segmentation for Multi-Utterance Constructs Annotation: LLM-Assisted and Gold-Label-Free Evaluation
Jinsook Lee, Kirk Vanacore, Zhuqian Zhou +3
Dialogue Act (DA) annotation typically treats communicative or pedagogical intent as localized to individual utterances or turns. This leads annotators to agree on the underlying a…
cs.AI2025
AI Annotation Orchestration: Evaluating LLM verifiers to Improve the Quality of LLM Annotations in Learning Analytics
Bakhtawar Ahtisham, Kirk Vanacore, Jinsook Lee +3
Large Language Models (LLMs) are increasingly used to annotate learning interactions, yet concerns about reliability limit their utility. We test whether verification-oriented orch…
cs.CL2025
Poor Alignment and Steerability of Large Language Models: Evidence from College Admission Essays
Jinsook Lee, AJ Alvero, Thorsten Joachims +1
People are increasingly using technologies equipped with large language models (LLM) to write texts for formal communication, which raises two important questions at the intersecti…