A Self-Attentive model for Knowledge Tracing

Abstract

Knowledge tracing is the task of modeling each student's mastery of knowledge concepts (KCs) as (s)he engages with a sequence of learning activities. Each student's knowledge is modeled by estimating the performance of the student on the learning activities. It is an important research area for providing a personalized learning platform to students. In recent years, methods based on Recurrent Neural Networks (RNN) such as Deep Knowledge Tracing (DKT) and Dynamic Key-Value Memory Network (DKVMN) outperformed all the traditional methods because of their ability to capture complex representation of human learning. However, these methods face the issue of not generalizing well while dealing with sparse data which is the case with real-world data as students interact with few KCs. In order to address this issue, we develop an approach that identifies the KCs from the student's past activities that are \textit{relevant} to the given KC and predicts his/her mastery based on the relatively few KCs that it picked. Since predictions are made based on relatively few past activities, it handles the data sparsity problem better than the methods based on RNN. For identifying the relevance between the KCs, we propose a self-attention based approach, Self Attentive Knowledge Tracing (SAKT). Extensive experimentation on a variety of real-world dataset shows that our model outperforms the state-of-the-art models for knowledge tracing, improving AUC by 4.43% on average.

International Conference on Education Data Mining

References in corpus (2)

• Deep Knowledge Tracing
• One-shot Learning with Memory-Augmented Neural Networks

Cited by in corpus (17)

• Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracing
• SAINT+: Integrating Temporal Features for EdNet Correctness Prediction
• EdNet: A Large-Scale Hierarchical Dataset in Education
• MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Education
• Application of Deep Self-Attention in Knowledge Tracing
• Assessment Modeling: Fundamental Pre-training Tasks for Interactive Educational Systems
• LANA: Towards Personalized Deep Knowledge Tracing Through Distinguishable Interactive Sequences
• RLTutor: Reinforcement Learning Based Adaptive Tutoring System by Modeling Virtual Student with Fewer Interactions
• Student Performance Prediction Using Dynamic Neural Models
• Last Query Transformer RNN for knowledge tracing
• Consistency and Monotonicity Regularization for Neural Knowledge Tracing
• MUSE: Multi-Scale Temporal Features Evolution for Knowledge Tracing
• An Empirical Comparison of Deep Learning Models for Knowledge Tracing on Large-Scale Dataset
• Explainable Knowledge Tracing Models for Big Data: Is Ensembling an Answer?
• Deep Knowledge Tracing with Learning Curves
• Knowledge Transfer by Discriminative Pre-training for Academic Performance Prediction
• Riiid! Answer Correctness Prediction Kaggle Challenge: 4th Place Solution Summary