Comparative Analysis of Machine Learning Classifier Models for Predicting Student Cognitive Load and Performance Outcomes in Moodle Learning Environment
الملخص
Background: Advancements in ICT have driven the widespread adoption of e-learning platforms like Moodle, enhancing education delivery and experience. While research has primarily focused on predicting learner performance using Moodle data, the role of cognitive load has been underexplored. Purpose: This study aimed to compare machine learning classifiers in predicting student cognitive load and performance within Moodle. Methodology: Conducted at the Technical University of Mombasa in Kenya between November and December 2023, the experiment involved 415 undergraduate students in a four-week online course powered by Moodle LMS. Participants were randomly assigned to a treatment group containing cognitive load management interventions or a control group, without interventions. Using Moodle logs, the predictive performance of Naïve Bayes (NB), Random Forests (RF), Support Vector Machines (SVM), and K-Nearest Neighbours (KNN) was analyzed with Python's Jupyter package. Findings: Results showed that NB had high precision (96.96%) and accuracy (93.04%) with minimal training time, while SVM also performed well with higher training time. RF excelled in accuracy but required more computational resources. Conclusion: The study suggests NB and SVM effectively predict cognitive load and performance. This knowledge can be utilized by LMS and instructional designers to advance data-driven student interventions in supporting student success in e-learning environments
التنزيلات
المراجع
Aeiad, E., & Meziane, F. (2019). An adaptable and personalised elearning system applied to computer. Education and Information Technologies, 78, 674–681.
Boulesteix, A. L., & Strobl, C. (2009). Optimal classifier selection and negative bias in error rate estimation: An empirical study on high-dimensional prediction. BMC Medical Research Methodology, 9, 1–14. https://doi.org/10.1186/1471-2288-9-85
Dobre, I. (2015). Learning Management Systems for Higher Education - An Overview of Available Options for Higher Education Organizations. Procedia - Social and Behavioral Sciences, 180(November 2014), 313–320. https://doi.org/10.1016/j.sbspro.2015.02.122
Garkule, V., & Makarevičs, V. (2018). Moodle Environment and Its Use Within Formal and Informal Education At a Vocational School. SOCIETY. INTEGRATION. EDUCATION. Proceedings of the International Scientific Conference, 5, 68– 80. https://doi.org/10.17770/sie2018vol1.3101
Garrison, D., Anderson, T., & Archer, W. (2000). Critical Inquiry in a text-based environment. The Internet and Higher Education, 2(2), 87–105.
Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education. Internet and Higher Education, 2(2– 3), 87– 105. https://doi.org/10.1016/S1096-7516(00)00016-6
Geron, A. (2016). Hand-on Machine Learning with Scikit-Learn,Keras and TensorFlow (Issue 0).
Hasan, R., Palaniappan, S., Mahmood, S., Abbas, A., Sarker, K. U., & Sattar, M. U. (2020). Predicting student performance in higher educational institutions using video learning analytics and data mining techniques. Applied Sciences (Switzerland), 10(11). https://doi.org/10.3390/app10113894
Ho, I. M. K., Cheong, K. Y., & Weldon, A. (2021). Predicting student satisfaction of emergency remote learning in higher education during COVID-19 using machine learning techniques. PLoS ONE, 16(4 April), 1– 27. https://doi.org/10.1371/journal.pone.0249423
Hoque, E. M. (2016). Three Domains of Learning: Cognitive, Affective and Psychomotor. The Journal of EFL Education and Research (JEFLER), 2(2), 2520–5897. www.edrc-jefler.org
Hstie, T., Tibshiran, R., & Jerome, F. (2013). The Elements of Statistical Learning, Data Mining, Inference and Prediction. In Springer. https://doi.org/10.1109/SITIS.2013.106
Juhanie, T., & Paas, F. (2017). Exploring Multidimensional Approaches to the Efficiency of Instructional Conditions Author (s): JUHANI E. TUOVINEN and FRED PAAS Source: Instructional Science, Vol. 32, No. 1 / 2, Special Issue: Advances in Cognitive Load Theory; Methodology an. 32(1), 133–152.
Kaensar, C., & Wongnin, W. (2023). Analysis and Prediction of Student Performance Based on Moodle Log Data using Machine Learning Techniques. International Journal of Emerging Technologies in Learning, 18(10), 184– 203. https://doi.org/10.3991/ijet.v18i10.35841
Kalyuga, S. (2012). Interactive distance education: A cognitive load perspective. Journal of Computing in Higher Education, 24(3), 182– 208. https://doi.org/10.1007/S12528-012-9060-4
Kalyuga, S., & Liu, T.-C. (2015). Guest Editorial: Managing Cognitive Load in Technology-Based Learning Environments. Journal of Educational Technology & Society, 18(4), 1–8. http://www.jstor.org/stable/jeductechsoci.18.4.1
Kante, M., Oboko, R., & Chepken, C. (2016). Factors affecting the use of ICT s on agricultural input information by farmers in developing countries. AIMS Agriculture and Food, 1(3), 315– 329. https://doi.org/10.3934/agrfood.2016.3.315
Kolekar, S. V., Pai, R. M., & Manohara Pai, M. M. (2018). Adaptive User Interface for Moodle-based E-learning System using Learning Styles. Procedia Computer Science, 135, 606– 615. https://doi.org/10.1016/j.procs.2018.08.226
Krishnan, R., Nair, S., Saamuel, B. S., Justin, S., Iwendi, C., Biamba, C., & Ibeke, E. (2022). Smart Analysis of Learners Performance Using Learning Analytics for Improving Academic Progression: A Case Study Model. Sustainability (Switzerland), 14(6), 1–13. https://doi.org/10.3390/su14063378
Lauren, G., & Vanessa, R. (2022). Understanding Cognitive Load Theory for better online course design. https://moodle.com/us/news/understanding-cognitive-load-theory-for-better-online-course-design/
Learning analytics indicators - MoodleDocs. (n.d.). https://docs.moodle.org/310/en/Learning_analytics_indicators
Młynarska, E., Greene, D., & Cunningham, P. (2016). Indicators of Good Student Performance in Moodle Activity Data. January. http://arxiv.org/abs/1601.02975
Oppong, S. O. (2023). Predicting Students’ Performance Using Machine Learning Algorithms: A Review. Asian Journal of Research in Computer Science, 16(3). https://doi.org/10.9734/ajrcos/2023/v16i3351
Quinn, R. J., & Gray, G. (2019). Prediction of student academic performance using Moodle data from a Further Education setting. Irish Journal of Technology Enhanced Learning, 5(1). https://doi.org/10.22554/ijtel.v5i1.57
Rachel, V., Sudhamathy, G., & Parthasarathy, M. (2018). Analytics on Moodle Data Using R Package for Enhanced Learning Management. International Journal of Applied Engineering Research, 13(22), 15580–15610. http://www.ripublication.com
Romero, C., & Ventura, S. (2020). Educational data mining and learning analytics: An updated survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(3), 1–21. https://doi.org/10.1002/widm.1355
Schunk, D. H. (2012). Learning Theories,An Educational Perspective,Sixth Edition. In Space Science Reviews (Vol. 71, Issues 1–4).
Segura, M., Mello, J., & Hernández, A. (2022). Machine Learning Prediction of University Student Dropout: Does Preference Play a Key Role? Mathematics, 10(18), 1–20. https://doi.org/10.3390/math10183359
Shayan, P., & van Zaanen, M. (2019). Predicting student performance from their behavior in learning management systems. International Journal of Information and Education Technology, 9(5), 337–341. https://doi.org/10.18178/ijiet.2019.9.5.1223
Skulmowski, A., & Rey, G. D. (2017). Measuring cognitive load in embodied learning settings. In Frontiers in Psychology (Vol. 8, Issue AUG, p. 1191). Frontiers Media S.A. https://doi.org/10.3389/fpsyg.2017.01191
Song, J. H., & Thompson, L. (2011). Ji Hoon Song, PhD. 24(3), 55– 76. https://doi.org/10.1002/piq
Sucharitha, G., Matta, A., & Dwarakamai, K. (2020). Theory and Implications of Information Processing. Emotion and Information Processing, January 2021. https://doi.org/10.1007/978-3-030-48849-9
Sun, J. C. Y., Liu, Y., Lin, X., & Hu, X. (2023). Temporal learning analytics to explore traces of self-regulated learning behaviors and their associations with learning performance, cognitive load, and student engagement in an asynchronous online course. Frontiers in Psychology, 13(January). https://doi.org/10.3389/fpsyg.2022.1096337
Sweller, J., Ayres, P., & Kalyuga, S. (2011). The Goal-Free Effect. Cognitive Load Theory, 89–98. https://doi.org/10.1007/978-1-4419-8126-4_7
Theng, D., & Theng, M. (2020). Machine Learning Algorithms for Predictive Analytics: A Review and New Perspectives. July, 1–10. https://doi.org/10.37896/HTL26.06/1159
Tlili, A., Denden, M., Essalmi, F., Jemni, M., Chang, M., Kinshuk, & Chen, N. S. (2023). Automatic modeling learner’s personality using learning analytics approach in an intelligent Moodle learning platform. Interactive Learning Environments, 31(5), 2529– 2543. https://doi.org/10.1080/10494820.2019.1636084
van Mierlo, C. M., Jarodzka, H., Kirschner, F., & Kirschner, P. A. (2012a). Cognitive load theory in e-learning. In Encyclopedia of Cyber Behavior (Vol. 1, Issue December 2015). https://doi.org/10.4018/978-1-4666-0315-8.ch097
van Mierlo, C. M., Jarodzka, H., Kirschner, F., & Kirschner, P. A. (2012b). Cognitive load theory in e-learning. In Encyclopedia of Cyber Behavior (Vol. 1, Issue January). https://doi.org/10.4018/978-1-4666-0315-8.ch097
Wasylewicz, A. T. M., & Scheepers-Hoeks, A. M. J. W. (2018). Clinical decision support systems. In Fundamentals of Clinical Data Science. https://doi.org/10.1007/978-3-319-99713-1_11
Yen, A. C., Chen, I., Lai, S., Chuang, Y., Yen, C., Chen, I., Lai, S., & Chuang, Y. (2015). An Analytics-Based Approach to Managing Cognitive Load by Using Log Data of Learning Management Systems and Footprints of Social Media Linked references are available on JSTOR for this article : An A. Educatinal Technology & Society, 18(4), 140– 158. file:///C:/Users/vdmerwer/Downloads/jeductechsoci.18.4.141.pdf
Yen, C.-H., Chen, I.-C., Lai, S.-C., & Chuang, Y.-R. (2015). An Analytics-Based Approach to Managing Cognitive Load by Using Log Data of Learning Management Systems and Footprints of Social Media. Journal of Educational Technology & Society, 18(4), 141– 158. http://www.jstor.org/stable/jeductechsoci.18.4.141
Young, M. (2015). What is learning and why does it matter? European Journal of Education, 50(1), 17– 20. https://doi.org/10.1111/ejed.12105
الحقوق الفكرية (c) 2024 Thaddeus Matundura Ogwoka, Robert Obwocha Oboko, PhD, Christopher Kipchumba Chepken, PhD
هذا العمل مرخص حسب الرخصة Creative Commons Attribution 4.0 International License.
