6 papers
What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts
Mohamad Al Mdfaa, Nursultan Askarbekuly, Ahmed Helaly +2
Checking Quran recitation from an ASR transcript requires distinguishing unresolved mistakes from repetitions, repairs, opening formulas and accepted spelling differences. We repor…
Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on Quran Recitation Data
Nursultan Askarbekuly, Mohamad Al Mdfaa, Ahmed Helaly +2
Coding agents can now be left alone to improve software against a score. In this pattern--recently popularized as "autoresearch"--the agent receives a dataset, an evaluation script…
An Outcome-Based Educational Recommender System
Nursultan Askarbekuly, Timur Fayzrakhmanov, Sladjan Babarogić +1
Most educational recommender systems are tuned and judged on click- or rating-based relevance, leaving their true pedagogical impact unclear. We introduce OBER-an Outcome-Based Edu…
Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions
Farah Atif, Nursultan Askarbekuly, Kareem Darwish +1
Despite the increasing usage of Large Language Models (LLMs) in answering questions in a variety of domains, their reliability and accuracy remain unexamined for a plethora of doma…
Learning Outcomes, Assessment, and Evaluation in Educational Recommender Systems: A Systematic Review
Nursultan Askarbekuly, Ivan Luković
In this paper, we analyse how learning is measured and optimized in Educational Recommender Systems (ERS). In particular, we examine the target metrics and evaluation methods used…
Quranic Audio Dataset: Crowdsourced and Labeled Recitation from Non-Arabic Speakers
Raghad Salameh, Mohamad Al Mdfaa, Nursultan Askarbekuly +1
This paper addresses the challenge of learning to recite the Quran for non-Arabic speakers. We explore the possibility of crowdsourcing a carefully annotated Quranic dataset, on to…