4 papers
Long Context Automated Essay Scoring with Language Models
Christopher Ormerod, Gitit Kehat
Transformer-based language models are architecturally constrained to process text of a fixed maximum length. Essays written by higher-grade students frequently exceed the maximum a…
SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty Prediction
Alexander Scarlatos, Nigel Fernandez, Christopher Ormerod +2
Item (question) difficulties play a crucial role in educational assessments, enabling accurate and efficient assessment of student abilities and personalization to maximize learnin…
Automated Essay Scoring Incorporating Annotations from Automated Feedback Systems
Christopher Ormerod
This study illustrates how incorporating feedback-oriented annotations into the scoring pipeline can enhance the accuracy of automated essay scoring (AES). This approach is demonst…
Cyborg Data: Merging Human with AI Generated Training Data
Kai North, Christopher Ormerod
Automated scoring (AS) systems used in large-scale assessment have traditionally used small statistical models that require a large quantity of hand-scored data to make accurate pr…