Combining Difficulty Ranking with Multi-Armed Bandits to Sequence Educational Content
arXiv:1804.05212 · doi:10.1016/j.physletb.2019.04.047
Abstract
As e-learning systems become more prevalent, there is a growing need for them to accommodate individual differences between students. This paper addresses the problem of how to personalize educational content to students in order to maximize their learning gains over time. We present a new computational approach to this problem called MAPLE (Multi-Armed Bandits based Personalization for Learning Environments) that combines difficulty ranking with multi-armed bandits. Given a set of target questions MAPLE estimates the expected learning gains for each question and uses an exploration-exploitation strategy to choose the next question to pose to the student. It maintains a personalized ranking over the difficulties of question in the target set which is used in two ways: First, to obtain initial estimates over the learning gains for the set of questions. Second, to update the estimates over time based on the students responses. We show in simulations that MAPLE was able to improve students' learning gains compared to approaches that sequence questions in increasing level of difficulty, or rely on content experts. When implemented in a live e-learning system in the wild, MAPLE showed promising results. This work demonstrates the efficacy of using stochastic approaches to the sequencing problem when augmented with information about question difficulty.
References in corpus (46)
- PYTHIA 6.4 Physics and Manual
- PYTHIA 6.2 Physics and Manual
- Suppression of Hadrons with Large Transverse Momentum in Central Au+Au Collisions at $sqrt {s sub {sub {NN}}}_ = 130 GeV
- Performance of the ALICE Experiment at the CERN LHC
- Transverse momentum and collision energy dependence of high hadron suppression in Au+Au collisions at ultrarelativistic energies
- The ALICE TPC, a large 3-dimensional tracking device with fast readout for ultra-high multiplicity events
- Evidence from d+Au measurements for final-state suppression of high hadrons in Au+Au collisions at RHIC
- Centrality dependence of high pT hadron suppression in Au+Au collisions at sqrt(sNN)=130 GeV
- Suppression of charged particle production at large transverse momentum in central Pb-Pb collisions at TeV
- Study of high-pT charged particle suppression in PbPb compared to pp collisions at sqrt(sNN)=2.76 TeV
- Centrality determination of Pb-Pb collisions at = 2.76 TeV with ALICE
- Induced Gluon Radiation in a QCD Medium
- Performance of the ALICE VZERO system
- Centrality dependence of charged particle production at large transverse momentum in Pb-Pb collisions at TeV
- Alignment of the ALICE Inner Tracking System with cosmic-ray tracks
- Transverse Momentum Spectra in Au+Au and d+Au Collisions at =200 GeV and the Pseudorapidity Dependence of High p Suppression
- Leading-particle suppression in high energy nucleus-nucleus collisions
- Charged-particle nuclear modification factors in PbPb and pPb collisions at sqrt(s[NN]) = 5.02 TeV
- Centrality dependence of particle production in p-Pb collisions at = 5.02 TeV
- Transverse momentum distribution and nuclear modification factor of charged particles in p-Pb collisions at = 5.02 TeV
- Transverse momentum spectra and nuclear modification factors of charged particles in pp, p-Pb and Pb-Pb collisions at the LHC
- Improved version of the PHOBOS Glauber Monte Carlo
- Measurement of isolated photon production in pp and PbPb collisions at sqrt(sNN) = 2.76 TeV
- Charged hadron transverse momentum distributions in Au+Au collisions at sqrt(s_NN) = 200 GeV
- Neutral pion production with respect to centrality and reaction plane in Au+Au collisions at sqrt(s_NN)=200 GeV
- Measurement of charged-particle spectra in Pb+Pb collisions at TeV with the ATLAS detector at the LHC
- Study of W boson production in PbPb and pp collisions at sqrt(s[NN]) = 2.76 TeV
- The PHOBOS Glauber Monte Carlo
- Quantitative Constraints on the Transport Properties of Hot Partonic Matter from Semi-Inclusive Single High Transverse Momentum Pion Suppression in Au+Au collisions at sqrt(s_NN) = 200 GeV
- A Detailed Study of High-pT Neutral Pion Suppression and Azimuthal Anisotropy in Au+Au Collisions at \sqrt{s_{NN}} = 200 GeV
- Transverse momentum spectra and nuclear modification factors of charged particles in Xe-Xe collisions at = 5.44 TeV
- Measurement of Direct Photons in Au+Au Collisions at sqrt(s_NN) = 200 GeV
- Study of Z boson production in PbPb collisions at nucleon-nucleon centre of mass energy = 2.76 TeV
- Personalized Course Sequence Recommendations
- Measurement of jet quenching with semi-inclusive hadron-jet distributions in central Pb-Pb collisions at = 2.76 TeV
- Multi-Armed Bandits for Intelligent Tutoring Systems
- Centrality Dependence of the High p_T Charged Hadron Suppression in Au+Au collisions at sqrt(s_NN) = 130 GeV
- Transverse momentum dependence of inclusive primary charged-particle production in p-Pb collisions at = 5.02 TeV
- Constraints on jet quenching in p-Pb collisions at = 5.02 TeV measured by the event-activity dependence of semi-inclusive hadron-jet distributions
- Absence of jet quenching in peripheral nucleus-nucleus collisions
- Transverse momentum, rapidity, and centrality dependence of inclusive charged-particle production in TeV p+Pb collisions measured by the ATLAS experiment
- Nuclear effects on the transverse momentum spectra of charged particles in pPb collisions at a nucleon-nucleon center-of-mass energy of 5.02 TeV
- Centrality, rapidity and transverse momentum dependence of isolated prompt photon production in lead-lead collisions at TeV measured with the ATLAS detector
- System size and centrality dependence of charged hadron transverse momentum spectra in Au+Au and Cu+Cu collisions at sqrt(s) = 62.4 and 200 GeV
- Influence of the nucleon-nucleon collision geometry on the determination of the nuclear modification factor for nucleon-nucleus and nucleus-nucleus collisions
- Jet Quenching and Its Azimuthal Anisotropy in AA and possibly High Multiplicity pA and dA Collisions
Cited by in corpus (29)
- Production of charged pions, kaons and (anti-)protons in Pb-Pb and inelastic pp collisions at = 5.02 TeV
- The ALICE experiment: a journey through QCD
- Prompt D, D, and D production in Pb-Pb collisions at = 5.02 TeV
- Determination of the neutron skin of Pb from ultrarelativistic nuclear collisions
- Direct real photons in relativistic heavy ion collisions
- Progress in the Glauber model at collider energies
- Measurement of electrons from semileptonic heavy-flavour hadron decays at midrapidity in pp and Pb-Pb collisions at = 5.02 TeV
- The hadronic nucleus-nucleus cross section and the nucleon size
- Measurement of boson production in Pb+Pb collisions at TeV with the ATLAS detector
- Studies of J/ production at forward rapidity in Pb-Pb collisions at = 5.02 TeV
- boson production in Pb+Pb collisions at = 5.02 TeV measured by the ATLAS experiment
- Charged-particle nuclear modification factors in XeXe collisions at = 5.44 TeV
- Underlying Event properties in pp collisions at = 13 TeV
- Constraints on the initial state of PbPb collisions via measurements of Z boson yields and azimuthal anisotropy at 5.02 TeV
- The Skinny on Bulk Viscosity and Cavitation in Heavy Ion Collisions
- Disentangling centrality bias and final-state effects in the production of high- using direct in Au collisions at GeV
- Nuclear modification factor in Pb-Pb and p-Pb collisions using Boltzmann transport equation
- Study of charged particle production at high using event topology in pp, pPb and PbPb collisions at TeV
- Centrality dependence of electroweak boson production in PbPb collisions at the LHC
- Review of nonflow estimation methods and uncertainties in relativistic heavy-ion collisions
- Glauber predictions for oxygen and neon collisions at energies available at the LHC
- "QM19 summary talk": Outlook and future of heavy-ion collisions
- Initial conditions for nuclear collisions: theory overview
- Selection bias effects on high- yield and correlation measurements in Oxygen+Oxygen collisions
- A unified description of small, peripheral, and large system suppression data from pQCD
- Measurement of the inclusive isolated-photon production cross section in pp and PbPb collisions at TeV
- Collective effects in O-O and Ne-Ne collisions at =5.36 TeV from a hybrid approach
- Azimuthal Correlation Anisotropies in p + p Collisions Simulated by Pythia
- Heavy-ion collisions - hot QCD in a lab