3 papers
stat.AP2026
The Rater Ising-Potts Model with LLM-Derived Weights: An Application to Multi-Category Scoring Reliability
Matthias von Davier
The Ising model is extended to the Potts model for multinomial data. We introduce a Rater Ising-Potts model that uses agreement indicators between pairs of raters and category labe…
stat.AP2026
Integrating Network Psychometrics and LLMs: The Ising-Embeddings-Model applied to Reliability Auditing
Matthias von Davier
Scoring consistency for constructed-response items in large-scale assessments is typically estimated through double-scoring, which uses small samples and assumes independence among…
cs.CL2026
Multilingual Sentence Embeddings for Linguistic-Integrated Reliability Audit
Ummugul Bezirhan, Ji Yoon Jung, Matthias von Davier
Multilingual assessment systems commonly rely on translation for scoring and quality-control processes. We evaluate whether multilingual sentence embeddings can replace translated…