5 papers
Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not Ground Truth
Alex Liu, Lief Esbenshade, Michael Xiao +4
Evaluations of LLM-assisted qualitative coding almost universally measure model performance as agreement with human coders, a practice that presumes human coding is the standard to…
Human-LLM Collaborative Inductive Coding for Conceptualizing K-12 Educator AI Use
Alex Liu, Min Sun, Lief Esbenshade +4
Qualitative researchers increasingly encounter interaction corpora whose scale exceeds what manual coding alone can address, and large language models (LLMs) are frequently propose…
Teacher-Authored Prompts for Configuring Student-AI Dialogue: K-12 Classroom Implementation
Alex Liu, Min Sun, Lief Esbenshade +3
GenAI has rapidly entered instructional and learning settings as a teaching assistant or AI tutor. However, less is known about how pedagogical intent connects to the learning gene…
How K-12 Educators Use AI: LLM-Assisted Qualitative Analysis at Scale
Alex Liu, Lief Esbenshade, Shawon Sarkar +4
This study investigates how K-12 educators use generative AI tools in real-world instructional contexts and how large language models (LLMs) can support scalable qualitative analys…
Adapting to Educate: Conversational AI's Role in Mathematics Education Across Different Educational Contexts
Alex Liu, Lief Esbenshade, Min Sun +4
As educational settings increasingly integrate artificial intelligence (AI), understanding how AI tools identify -- and adapt their responses to -- varied educational contexts beco…