16 citations · 24 across the 19 of their papers we have counts for
20 papers
Words to World: Benchmarking LLMs in Interactive Physical Environments
Xinnan Dai, Kaiqi Yang, Yaxin Li +9
Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. Howe…
Think-Before-Speak: From Internal Evaluation to Public Expression in Multi-Agent Social Simulation
Kaiqi Yang, Tai-Quan Peng, Sanguk Lee +1
LLM-based multi-agent simulation offers a promising way to study social interaction, deliberation, and collective opinion dynamics. However, many existing dialogue simulation frame…
"**Important** You should give me full credits!": Exploring Prompt Injection Attacks on LLM-Based Automatic Grading Systems
Hang Li, Fedor Filippov, Yuping Lin +6
The emergence of large language models (LLMs) has significantly accelerated recent research on LLM-based automatic grading (AG) systems. Benefiting from the strong instruction-foll…
From Flat to Structural: Enhancing Automated Short Answer Grading with GraphRAG
Yucheng Chu, Haoyu Han, Shen Dong +6
Automated short answer grading (ASAG) is critical for scaling educational assessment, yet large language models (LLMs) often struggle with hallucinations and strict rubric adherenc…
Optimizing In-Context Demonstrations for LLM-based Automated Grading
Yucheng Chu, Hang Li, Kaiqi Yang +4
Automated assessment of open-ended student responses is a critical capability for scaling personalized feedback in education. While large language models (LLMs) have shown promise…
Confusion-Aware Rubric Optimization for LLM-based Automated Grading
Yucheng Chu, Hang Li, Kaiqi Yang +4
Accurate and unambiguous guidelines are critical for large language model (LLM) based graders, yet manually crafting these prompts is often sub-optimal as LLMs can misinterpret exp…
LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning
Yu Zhu, Kai Yang
The reasoning capability of large language models (LLMs), defined as their ability to analyze, infer, and make decisions based on input information, is essential for building intel…
How Uncertain Is the Grade? A Benchmark of Uncertainty Metrics for LLM-Based Automatic Assessment
Hang Li, Kaiqi Yang, Xianxuan Long +9
The rapid rise of large language models (LLMs) is reshaping the landscape of automatic assessment in education. While these systems demonstrate substantial advantages in adaptabili…
Iterative LLM-Based Generation and Refinement of Distracting Conditions in Math Word Problems
Kaiqi Yang, Hang Li, Yucheng Chu +3
Mathematical reasoning serves as a crucial testbed for the intelligence of large language models (LLMs), and math word problems (MWPs) are a popular type of math problems. Most MWP…
Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
Hang Li, Kaiqi Yang, Yucheng Chu +2
Large language models (LLMs) have been widely used for problem-solving tasks. Most recent work improves their performance through supervised fine-tuning (SFT) with labeled data or…
A LLM-Driven Multi-Agent Systems for Professional Development of Mathematics Teachers
Kaiqi Yang, Hang Li, Yucheng Chu +4
Professional development (PD) serves as the cornerstone for teacher tutors to grasp content knowledge. However, providing equitable and timely PD opportunities for teachers poses s…
Enhancing LLM-Based Short Answer Grading with Retrieval-Augmented Generation
Yucheng Chu, Peng He, Hang Li +6
Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that posse…
LLM-based Automated Grading with Human-in-the-Loop
Yucheng Chu, Hang Li, Kaiqi Yang +2
The rise of artificial intelligence (AI) technologies, particularly large language models (LLMs), has brought significant advancements to the field of education. Among various appl…
Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions
Hang Li, Tianlong Xu, Kaiqi Yang +5
The rise of large language models (LLMs) offers new opportunities for automatic error detection in education, particularly for math word problems (MWPs). While prior studies demons…
Beyond Partisan Leaning: A Comparative Analysis of Political Bias in Large Language Models
Tai-Quan Peng, Kaiqi Yang, Sanguk Lee +4
As large language models (LLMs) become increasingly embedded in civic, educational, and political information environments, concerns about their potential political bias have grown…
Exploring Social Desirability Response Bias in Large Language Models: Evidence from GPT-4 Simulations
Sanguk Lee, Kai-Qi Yang, Tai-Quan Peng +2
Large language models (LLMs) are employed to simulate human-like responses in social surveys, yet it remains unclear if they develop biases like social desirability response (SDR)…
A LLM-Powered Automatic Grading Framework with Human-Level Guidelines Optimization
Yucheng Chu, Hang Li, Kaiqi Yang +4
Open-ended short-answer questions (SAGs) have been widely recognized as a powerful tool for providing deeper insights into learners' responses in the context of learning analytics…
Content Knowledge Identification with Multi-Agent Large Language Models (LLMs)
Kaiqi Yang, Yucheng Chu, Taylor Darwin +6
Teachers' mathematical content knowledge (CK) is of vital importance and need in teacher professional development (PD) programs. Computer-aided asynchronous PD systems are the most…
Are Large Language Models (LLMs) Good Social Predictors?
Kaiqi Yang, Hang Li, Hongzhi Wen +3
The prediction has served as a crucial scientific method in modern social studies. With the recent advancement of Large Language Models (LLMs), efforts have been made to leverage L…
Spectral-Aware Augmentation for Enhanced Graph Representation Learning
Kaiqi Yang, Haoyu Han, Wei Jin +1
Graph Contrastive Learning (GCL) has demonstrated remarkable effectiveness in learning representations on graphs in recent years. To generate ideal augmentation views, the augmenta…