1 citations · 1 across the 4 of their papers we have counts for
7 papers
Alice: A Large-Scale German Benchmark for Rubric-Based Multi-Dimensional Automatic Short Answer Scoring
Zhifan Sun, Sebastian Gombert, Jannik Lossjew +6
Automatic Short Answer Scoring (ASAS) is central to NLP for Education. However, openly available benchmarks remain scarce, and existing datasets largely address how well students a…
Sharp Partial Identification for Survival Model Comparison Without Target Outcomes
Won Gi Choi, Sun-Ho Kim, Min Soo Kim
We compare two locked survival prediction models in a target population before target survival outcomes are available. At a prespecified horizon, the estimand is the target Brier-r…
Evaluating LLM-as-a-Judge Beyond Score Alignment: A Psychometric Analysis of Residual Judging Difficulty
Longwei Cong, Sonja Hahn, Sebastian Gombert +4
Large language models (LLMs) are widely used as automatic judges, with validity typically assessed via alignment with human scores. However, aggregate agreement fails to reveal whe…
Estimating LLM Grading Ability and Response Difficulty in Automatic Short Answer Grading via Item Response Theory
Longwei Cong, Sonja Hahn, Sebastian Gombert +3
Automated short answer grading (ASAG) with large language models (LLMs) is commonly evaluated with aggregate metrics such as macro-F1 and Cohen's kappa. However, these metrics prov…
Confidence Estimation in Automatic Short Answer Grading with LLMs
Longwei Cong, Sonja Hahn, Sebastian Gombert +3
Automatic Short Answer Grading (ASAG) with generative large language models (LLMs) has recently demonstrated strong performance without task-specific fine-tuning, while also enabli…
Report on the Scoping Workshop on AI in Science Education Research 2025
Marcus Kubsch, Marit Kastaun, Peter Wulff +21
This report summarizes the outcomes of a two-day international scoping workshop on the role of artificial intelligence (AI) in science education research. As AI rapidly reshapes sc…
Concept Map Assessment Through Structure Classification
Laís P. V. Vossen, Isabela Gasparini, Elaine H. T. Oliveira +6
Due to their versatility, concept maps are used in various educational settings and serve as tools that enable educators to comprehend students' knowledge construction. An essentia…