7 papers
SciEval: A Benchmark for Automatic Evaluation of K-12 Science Instructional Materials
Zhaohui Li, Peng He, Zhiyuan Chen +4
The need to evaluate instructional materials for K-12 science education has become increasingly important, as more educators use generative AI to create instructional materials. Ho…
Can Multimodal LLMs See Science Instruction? Benchmarking Pedagogical Reasoning in K-12 Classroom Videos
Yixuan Shen, Peng He, Honglu Liu +6
K-12 science classrooms are rich sites of inquiry where students coordinate phenomena, evidence, and explanatory models through discourse; yet, the multimodal complexity of these i…
DrawSim-PD: Simulating Student Science Drawings to Support NGSS-Aligned Teacher Diagnostic Reasoning
Arijit Chakma, Peng He, Honglu Liu +4
Developing expertise in diagnostic reasoning requires practice with diverse student artifacts, yet privacy regulations prohibit sharing authentic student work for teacher professio…
Judging the Judges: Human Validation of Multi-LLM Evaluation for High-Quality K--12 Science Instructional Materials
Peng He, Zhaohui Li, Zeyuan Wang +2
Designing high-quality, standards-aligned instructional materials for K--12 science is time-consuming and expertise-intensive. This study examines what human experts notice when re…
Learning Progression-Guided AI Evaluation of Scientific Models To Support Diverse Multi-Modal Understanding in NGSS Classroom
Leonora Kaldaras, Tingting Li, Prudence Djagba +2
Learning Progressions (LPs) can help adjust instruction to individual learners needs if the LPs reflect diverse ways of thinking about a construct being measured, and if the LP-ali…
Enhancing LLM-Based Short Answer Grading with Retrieval-Augmented Generation
Yucheng Chu, Peng He, Hang Li +6
Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that posse…