Systematic Ensemble Model Selection Approach for Educational Data Mining

Abstract

A plethora of research has been done in the past focusing on predicting student's performance in order to support their development. Many institutions are focused on improving the performance and the education quality; and this can be achieved by utilizing data mining techniques to analyze and predict students' performance and to determine possible factors that may affect their final marks. To address this issue, this work starts by thoroughly exploring and analyzing two different datasets at two separate stages of course delivery (20 percent and 50 percent respectively) using multiple graphical, statistical, and quantitative techniques. The feature analysis provides insights into the nature of the different features considered and helps in the choice of the machine learning algorithms and their parameters. Furthermore, this work proposes a systematic approach based on Gini index and p-value to select a suitable ensemble learner from a combination of six potential machine learning algorithms. Experimental results show that the proposed ensemble models achieve high accuracy and low false positive rate at all stages for both datasets.

47 Pages, 20 figures, 13 tables, accepted in Elsevier's Knowledge-Based Systems

References in corpus (7)

• SMOTE: Synthetic Minority Over-sampling Technique
• Tree-based Intelligent Intrusion Detection System in Internet of Vehicles
• A CHAID Based Performance Prediction Model in Educational Data Mining
• Data Mining: A Prediction for Performance Improvement of Engineering Students using Classification
• Data Mining Applications: A comparative Study for Predicting Student's performance
• Data Mining : A prediction of performer or underperformer using classification
• Relationship between Student Engagement and Performance in e-Learning Environment Using Association Rules

Cited by in corpus (8)

• On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice
• MTH-IDS: A Multi-Tiered Hybrid Intrusion Detection System for Internet of Vehicles
• Multi-Stage Optimized Machine Learning Framework for Network Intrusion Detection
• Machine Learning Towards Intelligent Systems: Applications, Challenges, and Opportunities
• Multi-split Optimized Bagging Ensemble Model Selection for Multi-class Educational Data Mining
• Multi-Perspective Content Delivery Networks Security Framework Using Optimized Unsupervised Anomaly Detection
• Softwarization, Virtualization, & Machine Learning For Intelligent & Effective V2X Communications
• Convolution Neural Network Hyperparameter Optimization Using Simplified Swarm Optimization