3 papers
cs.CL2026
Measuring What Matters -- or What's Convenient?: Robustness of LLM-Based Scoring Systems to Construct-Irrelevant Factors
Cole Walsh, Rodica Ivan
Automated systems have been widely adopted across the educational testing industry for open-response assessment and essay scoring. These systems commonly achieve performance levels…
cs.CL2025
Using LLMs to identify features of personal and professional skills in an open-response situational judgment test
Cole Walsh, Rodica Ivan, Muhammad Zafar Iqbal +1
Academic programs are increasingly recognizing the importance of personal and professional skills and their critical role alongside technical expertise in preparing students for fu…
cs.CY2024
The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges
Okan Bulut, Maggie Beiting-Parrish, Jodi M. Casabianca +14
The integration of artificial intelligence (AI) in educational measurement has revolutionized assessment methods, enabling automated scoring, rapid content analysis, and personaliz…