Abstract
Learners’ satisfaction with Massive Open Online Courses (MOOCs) has been evaluated through quantitative approaches focusing on survey-based methods in several studies. User-Generated Content (UGC) has been an effective approach to assess users’ interactions with e-learning systems. Other than survey-based methods, the UGC generated from MOOCs learners can provide wider perspectives of learners’ experiences using text mining approaches. Educational Data Mining (EDM) uses data mining, machine learning, and statistics to explore the information generated from educational portals. This study aims to explore learners’ levels of satisfaction with MOOCs by presenting a new hybrid approach for EDM that combines both machine learning and survey-based methodologies to investigate the factors that can enhance learners’ satisfaction with MOOCs. To address the goal of this study, the Latent Dirichlet Allocation (LDA) is used for analyzing learners’ reviews, Self‐Organizing Maps (SOM) is used for data segmentation, and Adaptive Neuro-Fuzzy Inference Systems (ANFIS) is utilized for predicting the learners’ satisfaction from the identified factors. Based on the analysis of the first stage using the EDM approach, a research model is designed, and a questionnaire is distributed among MOOCs learners. The data is analyzed using PLS-SEM to provide proof of the reliability and validity of the research model and to confirm the significance of the research paths. Several methodological and practical contributions are presented based on the analysis of the proposed methodology.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Adamopoulos, P. (2013, 2013). What Makes a Great MOOC? An Interdisciplinary Analysis of Student Retention in Online Courses. Paper presented at the 34th International Conference on Information Systems: ICIS
Adinolfi, P., D’Avanzo, E., Lytras, M. D., Novo-Corti, I., & Picatoste, J. (2016). Sentiment analysis to evaluate teaching performance. International Journal of Knowledge Society Research (IJKSR), 7(4), 86–107.
Agrusti, F., Mezzini, M., & Bonavolontà, G. (2020). Deep learning approach for predicting university dropout: A case study at Roma Tre University. Journal of e-Learning and Knowledge Society, 16(1), 44–54.
Albelbisi, N. A., Al-Adwan, A. S., & Habibi, A. (2021). Self-regulated learning and satisfaction: A key determinants of MOOC success. Education and Information Technologies, 26(3), 3459–3481.
Albelbisi, N. A., & Yusop, F. D. (2020). Systematic review of a Nationwide Mooc initiative in Malaysian higher education system. Electronic Journal of e-Learning, 18(4), 287–298.
Alraimi, K. M., Zo, H., & Ciganek, A. P. (2015). Understanding the MOOCs continuance: The role of openness and reputation. Computers & Education, 80, 28–38.
Alyoussef, I. Y. (2021). Massive Open Online Course (MOOCs) Acceptance: The Role of Task-Technology Fit (TTF) for Higher Education Sustainability. Sustainability, 13(13), 7374.
Amaral, F., Tiago, T., & Tiago, F. (2014). User-generated content: Tourists’ profiles on Tripadvisor. International Journal of Strategic Innovative Marketing, 1(3), 137–145. https://doi.org/10.15556/ijsim.01.03.002
Amaro, S., Duarte, P., & Henriques, C. (2016). Travelers’ use of social media: A clustering approach. Annals of Tourism Research, 59, 1–15.
Anggraini, A., Tanuwijaya, C. N., Oktavia, T., Meyliana, M., Prabowo, H., & Supangkat, S. H. (2018). Analyzing MOOC features for enhancing students learning satisfaction. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 10(1–4), 67–71.
Aparicio, M., Oliveira, T., Bacao, F., & Painho, M. (2019). Gamification: A key determinant of massive open online course (MOOC) success. Information & Management, 56(1), 39–54.
Au, C. H., Lam, K. C. S., Fung, W. S. L., & Xu, X. (2016 2016). Using animation to develop a MOOC on Information Security.
Baykasoğlu, A., Özbel, B. K., Dudaklı, N., Subulan, K., & Şenol, M. E. (2018). Process mining based approach to performance evaluation in computer-aided examinations. Computer Applications in Engineering Education, 26(5), 1841–1861.
Bosch, N. (2021). Identifying supportive student factors for mindset interventions: A two-model machine learning approach. Computers & Education, 167, 104190.
Brown, A., & Reade, J. J. (2019). The wisdom of amateur crowds: Evidence from an online community of sports tipsters. European Journal of Operational Research, 272(3), 1073–1081.
Celar, S., Stojkic, Z., Seremet, Z., Marusic, Z., & Zelenika, D. (2015). Classification of test documents based on handwritten student ID’s characteristics. Procedia Engineering, 100, 782–790.
Chau, H., Labutov, I., Thaker, K., He, D., & Brusilovsky, P. (2020). Automatic concept extraction for domain and student modeling in adaptive textbooks. International Journal of Artificial Intelligence in Education, 1–27.
Chen, C.-C., Lee, C.-H., & Hsiao, K.-L. (2018). Comparing the determinants of non-MOOC and MOOC continuance intention in Taiwan: Effects of interactivity and openness. Library Hi Tech.
Chen, W.-K., Riantama, D., & Chen, L.-S. (2021). Using a text mining approach to hear voices of customers from social media toward the fast-food restaurant industry. Sustainability, 13(1), 268.
Chen, Y., Gao, Q., Yuan, Q., & Tang, Y. (2020). Discovering MOOC learner motivation and its moderating role. Behaviour & Information Technology, 39(12), 1257–1275.
Choi, Y.-L. (2020). K-MOOC Course Development and Learners’ Satisfaction Analysis-Focusing on Apparel Pattern CAD Education. Journal of the Korean Society of Clothing and Textiles, 44(2), 369–383.
Chopra, G., & Madan, P. (2021). Role of’potential self-efficacy’on e-learning effectiveness: A gender-specific moderated mediation model. International Journal of Learning and Change, 13(2), 190–217.
Coelho, O. B., & Silveira, I. (2017, 2017). Deep learning applied to learning analytics and educational data mining: A systematic literature review. Paper presented at the Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE) Brazil.
Cosma, G., & Acampora, G. (2016). A computational intelligence approach to efficiently predicting review ratings in e-commerce. Applied Soft Computing, 44, 153–162.
Coussement, K., Phan, M., De Caigny, A., Benoit, D. F., & Raes, A. (2020). Predicting student dropout in subscription-based online learning environments: The beneficial impact of the logit leaf model. Decision Support Systems, 135, 113325.
Cox, C., Burgess, S., Sellitto, C., & Buultjens, J. (2009). The role of user-generated content in tourists’ travel planning behavior. Journal of Hospitality Marketing & Management, 18(8), 743–764. https://doi.org/10.1080/19368620903235753
Dadgarnia, A., & Heidari, A. (2010). A fast systematic approach for microstrip antenna design and optimization using ANFIS and GA. Journal of Electromagnetic Waves and Applications, 24(16), 2207-2221.
Dai, H. M., Teo, T., & Rappa, N. A. (2020). Understanding continuance intention among MOOC participants: The role of habit and MOOC performance. Computers in Human Behavior, 112, 106455.
Daneji, A. A., Ayub, A. F. M., & Khambari, M. N. M. (2019). The Effects of Perceived Usefulness, Confirmation and Satisfaction on Continuance Intention in Using Massive Open Online Course (MOOC). Knowledge Management & E-Learning, 11(2), 201–214.
De Carvalho Junior, G. L., Robles, D. C., de la Serna, M. C., & Rivas, M. R. (2019). Comparative study SPOC VS. MOOC for socio-technical contents from usability and user satisfaction. Turkish Online Journal Of Distance Education, 20(2), 4–20.
De Freitas, S. I., Morgan, J., & Gibson, D. (2015). Will MOOCs transform learning and teaching in higher education? Engagement and course retention in online learning provision. British Journal of Educational Technology, 46(3), 455–471.
Delen, D. (2010). A comparative analysis of machine learning techniques for student retention management. Decision Support Systems, 49(4), 498–506.
Delen, D., Zaim, H., Kuzey, C., & Zaim, S. (2013). A comparative analysis of machine learning systems for measuring the impact of knowledge management practices. Decision Support Systems, 54(2), 1150–1160.
DeLone, W. H., & McLean, E. R. (2004). Measuring e-commerce success: Applying the DeLone & McLean information systems success model. International Journal of Electronic Commerce, 9(1), 31–47.
Deng, R., & Benckendorff, P. (2021). What are the key themes associated with the positive learning experience in MOOCs? An empirical investigation of learners’ ratings and reviews. International Journal of Educational Technology in Higher Education, 18(1), 1–28.
Dikcius, V., Urbonavicius, S., Adomaviciute, K., Degutis, M., & Zimaitis, I. (2021). Learning marketing online: The role of social interactions and gamification rewards. Journal of Marketing Education, 43(2), 159–173.
Dursun, O. F., Kaya, N., & Firat, M. (2012). Estimating discharge coefficient of semi-elliptical side weir using ANFIS. Journal of hydrology, 426, 55-62.
Dutt, A., Ismail, M. A., & Herawan, T. (2017). A systematic review on educational data mining. Ieee Access, 5, 15991-16005.
El-Alfy, E.-S.M., & Abdel-Aal, R. E. (2008). Construction and analysis of educational tests using abductive machine learning. Computers & Education, 51(1), 1–16.
Elouazizi, N., Birol, G., Jandciu, E., Öberg, G., Welsh, A., Han, A., & Campbell, A. (2017). Automated analysis of aspects of written argumentation.
Ferreira‐Mello, R., André, M., Pinheiro, A., Costa, E., & Romero, C. (2019). Text mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(6), e1332.
Fianu, E., Blewett, C., Ampong, G. O. A., & Ofori, K. S. (2018). Factors affecting MOOC usage by students in selected Ghanaian universities. Education Sciences, 8(2), 70.
Fidalgo-Blanco, Á., Sein-Echaluce, M. L., & García-Peñalvo, F. J. (2016). From massive access to cooperation: Lessons learned and proven results of a hybrid xMOOC/cMOOC pedagogical approach to MOOCs. International Journal of Educational Technology in Higher Education, 13(1), 1–13.
Grivokostopoulou, F., Perikos, I., & Hatzilygeroudis, I. (2017). An educational system for learning search algorithms and automatically assessing student performance. International Journal of Artificial Intelligence in Education, 27(1), 207–240.
Güneri, A. F., Ertay, T., & Yücel, A. (2011). An approach based on ANFIS input selection and modeling for supplier selection problem. Expert systems with applications, 38(12), 14907-14917.
Gupta, S., & Sabitha, A. S. (2019). Deciphering the attributes of student retention in massive open online courses using data mining techniques. Education and Information Technologies, 24(3), 1973–1994.
Hair, J., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2013). A primer on partial least squares structural equation modeling (Vol. 46). SAGE Publications Inc.
Hew, K. F., Hu, X., Qiao, C., & Tang, Y. (2020). What predicts student satisfaction with MOOCs: A gradient boosting trees supervised machine learning and sentiment analysis approach. Computers & Education, 145, 103724.
Hone, K. S., & El Said, G. R. (2016). Exploring the factors affecting MOOC retention: A survey study. Computers & Education, 98, 157–168.
Iam-On, N., & Boongoen, T. (2017). Generating descriptive model for student dropout: A review of clustering approach. Human-Centric Computing and Information Sciences, 7(1), 1–24.
Islam, A. K. M. N. (2011). The determinants of the post-adoption satisfaction of educators with an e-learning system. Journal of Information Systems Education, 22(4), 319.
Jang, J.-S. (1993). ANFIS: adaptive-network-based fuzzy inference system. IEEE transactions on systems, man, and cybernetics, 23(3), 665-685.
Jia, M., Gong, D., Luo, J., Zhao, J., Zheng, J., & Li, K. (2019). Who can benefit more from massive open online courses? A prospective cohort study. Nurse Education Today, 76, 96–102.
Jo, D. (2018). Exploring the Determinants of MOOCs continuance intention. KSII Transactions on Internet and Information Systems (TIIS), 12(8), 3992–4005.
Kapur, B., Ahluwalia, N., & Sathyaraj, R. (2017). Comparative Study on Marks Prediction using Data Mining and Classification Algorithms. International Journal of Advanced Research in Computer Science, 8(3).
Kerr, R., Merciai, I., & Eradze, M. (2018). Addressing cultural and linguistic diversity in an online learning environment. Educational Media International, 55(4), 317–332.
Khan, I. U., Hameed, Z., Yu, Y., Islam, T., Sheikh, Z., & Khan, S. U. (2018). Predicting the acceptance of MOOCs in a developing country: Application of task-technology fit model, social motivation, and self-determination theory. Telematics and Informatics, 35(4), 964–978.
Kim, J., Park, J., Lee, J., Kim, S., Gonzalez-Jimenez, H., Lee, J., . . . Franklin, D. (2021). COVID-19 and Extremeness Aversion: The Role of Safety Seeking in Travel Decision Making. Journal of Travel Research, 00472875211008252.
Kim, K., Trimi, S., Park, H., & Rhee, S. (2012). The impact of CMS quality on the outcomes of e-learning systems in higher education: An empirical study. Decision Sciences Journal of Innovative Education, 10(4), 575–587.
Kostromitina, M., Keller, D., Cavusoglu, M., & Beloin, K. (2021). “His lack of a mask ruined everything.” Restaurant customer satisfaction during the COVID-19 outbreak: An analysis of Yelp review texts and star-ratings. International journal of hospitality management, 98, 103048.
Kumar, A., & Arora, A. (2020). An ANFIS-based compatibility scorecard for IoT integration in websites. The Journal of Supercomputing, 76(4), 2568-2596.
Leung, K., Choy, K. L., Ho, G. T., Lee, C. K., Lam, H., & Luk, C. (2019). Prediction of B2C e-commerce order arrival using hybrid autoregressive-adaptive neuro-fuzzy inference system (AR-ANFIS) for managing fluctuation of throughput in e-fulfilment centres. Expert systems with applications, 134, 304-324.
Li, J., Sun, L., Tang, Y., & Hu, X. (2017, 2017). Text analysis with LIWC and Coh-Metrix: Portraying MOOCs Instructors.
Li, L., Johnson, J., Aarhus, W., & Shah, D. (2021). Key factors in MOOC pedagogy based on NLP sentiment analysis of learner reviews: What makes a hit. Computers & Education, 104354.
Liaqat, A., Munteanu, C., & Epp, C. D. (2020). Collaborating with Mature English Language Learners to Combine Peer and Automated Feedback: a User-Centered Approach to Designing Writing Support. International Journal of Artificial Intelligence in Education, 1–42.
Liu, S., Peng, X., Cheng, H. N. H., Liu, Z., Sun, J., & Yang, C. (2019). Unfolding sentimental and behavioral tendencies of learners’ concerned topics from course reviews in a MOOC. Journal of Educational Computing Research, 57(3), 670–696.
Lowenthal, P. R., & Hodges, C. B. (2015). In search of quality: Using quality matters to analyze the quality of massive, open, online courses (MOOCs). International Review of Research in Open and Distributed Learning, 16(5), 83–101.
Lu, W., & Stepchenkova, S. (2015). User-generated content as a research mode in tourism and hospitality applications: Topics, methods, and software. Journal of Hospitality Marketing & Management, 24(2), 119-154. doi:https://doi.org/10.1080/19368623.2014.907758
Lu, Y., Wang, B., & Lu, Y. (2019). Understanding key drivers of MOOC satisfaction and continuance intention to use. Journal of Electronic Commerce Research, 20(2).
Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of massive open online courses (MOOCs). Computers & Education, 80, 77–83.
Masethe, M. A., Ojo, S. O., Odunaike, S. A., & Masethe, H. D. (2021). Framework of recommendation systems for educational data mining (EDM) methods: CBR-RS with KNN Implementation. In Transactions on Engineering Technologies (pp. 87–98): Springer.
Mohamad, S. K., & Tasir, Z. (2013). Educational data mining: A review. Procedia-Social and Behavioral Sciences, 97, 320-324.
Nie, Y., Luo, H., & Sun, D. (2021). Design and validation of a diagnostic MOOC evaluation method combining AHP and text mining algorithms. Interactive Learning Environments, 29(2), 315-328.
Noskova, T., Pavlova, T., & Yakovleva, O. (2021). A study of students’ preferences in the information resources of the digital learning environment. Journal on Efficiency and Responsibility in Education and Science, 14(1), 53–65.
Okubo, F., Yamashita, T., Shimada, A., & Ogata, H. (2017, 2017). A neural network approach for students' performance prediction. Paper presented at the Seventh international learning analytics & knowledge conference
Oleshko, M., Kostrova, A., & Lisyukov, R. (2020, 2020//). Value Dimensions in the Reviews of the MOOCs Students. Paper presented at the Digital Transformation and Global Society, Cham.
Padma, P., & Ahn, J. (2020). Guest satisfaction & dissatisfaction in luxury hotels: An application of big data. International journal of hospitality management, 84, 102318.
Palacios, C. A., Reyes-Suárez, J. A., Bearzotti, L. A., Leiva, V., & Marchant, C. (2021). Knowledge discovery for higher education student retention based on data mining: Machine learning algorithms and case study in Chile. Entropy, 23(4), 485.
Pechenizkiy, M., Trcka, N., Vasilyeva, E., Van der Aalst, W., & De Bra, P. (2009). Process mining online assessment data. International Working Group on Educational Data Mining.
Peng, X., & Xu, Q. (2020). Investigating learners' behaviors and discourse content in MOOC course reviews. Computers & Education, 143, 103673.
Pierrakeas, C., Koutsonikos, G., Lipitakis, A.-D., Kotsiantis, S., Xenos, M., & Gravvanis, G. A. (2019). The Variability of the Reasons for Student Dropout in Distance. Machine Learning Paradigms: Advances in Learning Analytics, 158, 91.
Pozón-López, I., Kalinic, Z., Higueras-Castillo, E., & Liébana-Cabanillas, F. (2020). A multi-analytical approach to modeling of customer satisfaction and intention to use in Massive Open Online Courses (MOOC). Interactive Learning Environments, 28(8), 1003–1021.
Raffaghelli, J., Ghislandi, P., Sancassani, S., Canal, L., Micciolo, R., Balossi, B., . . . Gondoni, P. (2018). Integrating MOOCs in physics preliminary undergraduate education: beyond large size lectures. Educational Media International, 55(4), 301-316.
Romero, C., & Ventura, S. (2013). Data mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 3(1), 12–27.
Santamaría-Bonfil, G., Ibáñez, M. B., Pérez-Ramírez, M., Arroyo-Figueroa, G., & Martínez-Álvarez, F. (2020). Learning analytics for student modeling in virtual reality training systems: Lineworkers case. Computers & Education, 151, 103871.
Santos, C. L., Rita, P., & Guerreiro, J. (2018). Improving international attractiveness of higher education institutions based on text mining and sentiment analysis. International Journal of Educational Management.
Shaheen, M. N. K., Shah, N. H., & Naqeeb, H. (2019). The Use of ICT for Assessment and Evaluation. International Journal of Distance Education and E-Learning, 5(1), 17–28.
Singh, A., & Sharma, A. (2021). Acceptance of MOOCs as an alternative for internship for management students during COVID-19 pandemic: an Indian perspective. International Journal of Educational Management.
Stephens-Martinez, K., Hearst, M. A., & Fox, A. (2014). Monitoring moocs: which information sources do instructors value? Paper presented at the Proceedings of the first ACM conference on Learning@ scale conference.
Trausan-Matu, S., Dascalu, M., & Rebedea, T. (2012). A system for the automatic analysis of Computer-Supported Collaborative Learning chats. Paper presented at the 2012 IEEE 12th International Conference on Advanced Learning Technologies.
Watson, S. L., Watson, W. R., Janakiraman, S., & Richardson, J. (2017). A team of instructors’ use of social presence, teaching presence, and attitudinal dissonance strategies: An animal behaviour and welfare MOOC. International Review of Research in Open and Distributed Learning, 18(2), 68–91.
Watson, W. R., Yu, J. H., & Watson, S. L. (2018). Perceived attitudinal learning in a self-paced versus fixed-schedule MOOC. Educational Media International, 55(2), 170–181.
Wen, M., Yang, D., & Rose, C. (2014, 2014). Sentiment analysis in MOOC discussion forums: What does it tell us? Paper presented at the Proceedings of Educational Data Mining.
Wijesinghe, D. B., Kadupitiya, J., Ranathunga, S., & Dias, G. (2017). Automatic assessment of student answers consisting of venn and euler diagrams.
Xiao, J., Tan, E., Li, X., Cao, M., & Specht, M. (2020). Using social media in mobile MOOC for teacher professional development. International Journal of Mobile Learning and Organisation, 14(4), 492–510.
Xie, J., & Xu, B. (2018). Application of the MOOC mixed teaching method under the background of internet+ education. Educational Sciences: Theory & Practice, 18(6).
Yadegaridehkordi, E., Nilashi, M., Nasir, M. H. N. B. M., Momtazi, S., Samad, S., Supriyanto, E., & Ghabban, F. (2021). Customers segmentation in eco-friendly hotels using multi-criteria and machine learning techniques. Technology in Society, 65, 101528. https://doi.org/10.1016/j.techsoc.2021.101528
Yaeger, J. L., & Grooms, L. D. (2020). Are E-Texts the future of distance education? Investigating online students' open resource preferences. Journal of Educators Online, 17(2), n2.
Yakubu, M. N., & Dasuki, S. (2018). Assessing eLearning systems success in Nigeria: An application of the DeLone and McLean information systems success model. Journal of Information Technology Education: Research, 17, 183–203.
Yanchun, W., Man, W., & Hao, C. (2020, 2020). The element mining of MOOC teaching satisfaction based on online comments. Paper presented at the International Conference on Information Science and Education (ICISE-IE).
Yang, M., Shao, Z., Liu, Q., & Liu, C. (2017). Understanding the quality factors that influence the continuance intention of students toward participation in MOOCs. Educational Technology Research and Development, 65(5), 1195–1214.
Yu, J. H., & Watson, S. L. (2020). Identifying subtypes of attitudinal learning among MOOCs learners: a latent profile analysis. Open Learning: The Journal of Open, Distance and e-Learning, 1–20.
Zhang, J. (2016). Can MOOCs be interesting to students? An experimental investigation from regulatory focus perspective. Computers & Education, 95, 340–351.
Zhu, M., Sari, A., & Lee, M. M. (2018). A systematic review of research methods and topics of the empirical MOOC literature (2014–2016). The Internet and Higher Education, 37, 31-39.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nilashi, M., Abumalloh, R.A., Zibarzani, M. et al. What Factors Influence Students Satisfaction in Massive Open Online Courses? Findings from User-Generated Content Using Educational Data Mining. Educ Inf Technol 27, 9401–9435 (2022). https://doi.org/10.1007/s10639-022-10997-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-022-10997-7