Logo image
Back
Explainable artificial intelligence-machine learning models to estimate overall scores in tertiary preparatory general science course
Journal article   Open access   Peer reviewed

Explainable artificial intelligence-machine learning models to estimate overall scores in tertiary preparatory general science course

Sujan Ghimire, Shahab Abdulla, Lionel P Joseph, Salvin Prasad, Angela Murphy, Aruna Devi, Prabal Datta Barua, Ravinesh C Deo, U. Rajendra Acharya and Zaher Mundher Yaseen
Computers and Education: Artificial Intelligence, Vol.7, pp.1-30
2024
DOI: https://doi.org/10.1016/j.caeai.2024.100331
pdf
1-s2.0-S2666920X24001346-main6.52 MBDownloadView
Published VersionCC BY-NC-ND V4.0,  Open Access

Abstract

Education systems tertiary preparatory program student performance prediction students at risk education models deep learning machine learning support vector regression
Educational data mining is valuable for uncovering latent relationships in educational settings, particularly for predicting students' academic performance. This study introduces an interpretable hybrid model, optimised through Tree-structured Parzen Estimation (TPE) and Support Vector Regression (SVR), to predict overall scores (OT) utilising five assignments and one examination mark as predictors. Neural Network-based, Tree-Based, Ensemble-Based, and Boosting-based methods are evaluated against the hybrid TPE-optimised SVR model for forecasting final examination grades among 492 students enrolled in the TPP7155 (General Science) course at the University of Southern Queensland, Australia, during the 2020-2021 academic year. Additionally, Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive explanations (SHAP) techniques are employed to elucidate the inner workings of these prediction models. The findings highlight the superior performance of the proposed model, exhibiting the lowest Root Mean Squared Error (RMSE) and Relative Root Mean Squared Error (RRMSE), as well as the highest Willmott's index (WI), Legates–McCabe index (LM), and Nash–Sutcliffe Efficiency (NS). With assignment and examination marks identified as pivotal predictors of OT. SHAP and LIME analyses reveal the examination score (ET) as the most influential feature, impacting predicted OT by an average of ±4.93. Conversely, Assignment 1 emerges as the least informative feature, contributing merely ±0.64 to OT predictions. This research underscores the efficacy of the proposed interpretable hybrid TPE-optimised SVR model in discerning relationships among continuous learning variables, thereby empowering educators with early intervention capabilities and enhancing their ability to anticipate student performance prior to course completion.

Details

Metrics

40 Record Views
Logo image