Abstract
Course evaluation plays a crucial role in analysing the effectiveness of a course. Despite the emerging trend of applying learning analytics approaches to course evaluation, only limited research has been conducted on reviewing and examining the features of relevant practices. This study analysed the learning analytics approaches used for supporting course evaluation. It covered 27 empirical studies collected from Scopus that were published between 2013 and 2022. The results show the purposes of course evaluation based on learning analytics, including the enhancement of learning experience, effectiveness in learning and teaching, and learning performance and engagement. They also highlight the popular types of data for the learning analytics approaches, such as student performance, feedback, and online learning behaviours, as well as the analytical methods frequently applied, such as statistical tests, content analysis, and descriptive statistics. Additionally, the data visualisation methods most frequently used are also identified, such as tables, bar charts, and line charts. These findings inform the use of learning analytics in course evaluation and provide practical references for its implementation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Long, P., Siemens, G.: Penetrating the fog: analytics in learning and education. Educause Rev. 46(5), 30–40 (2011)
Wong, B.T.M.: Learning analytics in higher education: an analysis of case studies. Asian Assoc. Open Univ. J. 12(1), 21–40 (2017)
Wong, B.T.M., Li, K.C., Choi, S.P.M.: Trends in learning analytics practices: a review of higher education institutions. Interact. Technol. Smart Educ. 15(2), 132–154 (2018)
Wong, B.T.M., Li, K.C., Cheung, S.K.S.: An analysis of learning analytics in personalised learning. J. Comput. High. Educ. 35(3), 371–390 (2022)
Lan, A.S., Waters, A.E., Studer, C., Baraniuk, R.G.: Sparse factor analysis for learning and content analytics. J. Mach. Learn. Res. 15(1), 1959–2008 (2014)
Leitner, P., Khalil, M., Ebner, M.: Learning analytics in higher education—a literature review. In: Peña-Ayala, A. (ed.) Learning Analytics: Fundaments, Applications, and trends: A View of the Current State of the Art to Enhance E-learning, pp. 1–23. Springer, Cham (2017)
Cronbach, L.J.: Course improvement through evaluation. Teach. Coll. Rec. 64(8), 1–13 (1963)
Alturkistani, A., et al.: Massive open online course evaluation methods: systematic review. J. Med. Internet Res. 22(4), e13851 (2020)
Avery, R.J., Bryant, W.K., Mathios, A., Kang, H., Bell, D.: Electronic course evaluations: does an online delivery system influence student evaluations? J. Econ. Educ. 37(1), 21–37 (2006)
Edström, K.: Doing course evaluation as if learning matters most. High. Educ. Res. Dev. 27(2), 95–106 (2008)
Peterson, S.L., Wittstrom, K.M., Smith, M.J.: A course assessment process for curricular quality improvement. Am. J. Pharm. Educ. 75(8), 157 (2011)
Ozdemir, D., Opseth, H.M., Taylor, H.: Leveraging learning analytics for student reflection and course evaluation. J. Appl. Res. High. Educ. 12(1), 27–37 (2020)
Roll, I., Macfadyen, L.P., Sandilands, D.: Evaluating the relationship between course structure, learner activity, and perceived value of online courses. In: Proceedings of the Second ACM Conference on Learning@ Scale, pp. 385–388 (2015)
Lubis, F.F., Rosmansyah, Y., Supangkat, S.H.: Topic discovery of online course reviews using LDA with leveraging reviews helpfulness. Int. J. Electr. Comp. Eng. 9(1), 426–438 (2019)
Soledad, M., Grohs, J., Bhaduri, S., Doggett, J., Williams, J., Culver, S.: Leveraging institutional data to understand student perceptions of teaching in large engineering classes. In: Proceedings of Frontiers in Education Conference, pp.1–8 (2017)
Smith, C.: Building effectiveness in teaching through targeted evaluation and response: connecting evaluation to teaching improvement in higher education. Assess. Eval. High. Educ. 33(5), 517–533 (2008)
Braga, M., Paccagnella, M., Pellizzari, M.: Evaluating students’ evaluations of professors. Econ. Educ. Rev. 41, 71–88 (2014)
Gelmez, K., Efilti, P., Yilmaz, O.: “Well, a tough question. Congratulations:” How and in what aspects do design students evaluate a design studio course?. Int. J. Technol. Des. Educ. 33(4), 1585–1606 (2023)
Hew, K.F., Martinez, R., Lee, J.Y.: Online education evaluation: what should we evaluate? In: Proceedings of the Association for Educational Communications and Technology, pp. 243–246 (2004)
Bingham, R., Ottewill, R.: Whatever happened to peer review? Revitalising the contribution of tutors to course evaluation. Qual. Assur. Educ. 9(1), 32–39 (2001)
Feldman, K.A.: Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Res. High. Educ. 30, 137–194 (1989)
Marsh, H.W., Roche, L.A.: Making students’ evaluations of teaching effectiveness effective: the critical issues of validity, bias, and utility. Am. Psychol. 52(11), 1187 (1997)
Kogan, J.R., Shea, J.A.: Course evaluation in medical education. Teach. Teach. Educ. 23(3), 251–264 (2007)
Anderson, H.M., Cain, J., Bird, E.: Online student course evaluations: review of literature and a pilot study. Am. J. Pharm. Educ. 69(1–5), 34–43 (2005)
Pyasi, S., Gottipati, S., Shankararaman, V.: Sufat-an analytics tool for gaining insights from student feedback comments. In: Proceedings of Frontiers in Education Conference, pp. 1–9 (2018)
Kazanidis, I., Valsamidis, S., Gounopoulos, E., Kontogiannis, S.: Proposed S-Algo+ data mining algorithm for web platforms course content and usage evaluation. Soft. Comput. 24, 14861–14883 (2020)
Alalawi, K., Athauda, R., Chiong, R.: An innovative framework to improve course and student outcomes. In: Proceedings of 6th International Conference on Innovative Technology in Intelligent System and Industrial Applications, pp. 1–6 (2021)
Li, K.C., Wong, B.T.M.: Trends of learning analytics in STE(A)M education: a review of case studies. Interact. Technol. Smart Educ. 17(3), 323–335 (2020)
Sekeroglu, B., Abiyev, R., Ilhan, A., Arslan, M., Idoko, J.B.: Systematic literature review on machine learning and student performance prediction: critical gaps and possible remedies. Appl. Sci. 11(22), 10907 (2021)
Alwarthan, S.A., Aslam, N., Khan, I.U.: Predicting student academic performance at higher education using data mining: a systematic review. Appl. Comput. Intell. Soft Comput. (2022). https://doi.org/10.1155/2022/8924028
Ifenthaler, D., Yau, J.Y.K.: Utilising learning analytics to support study success in higher education: a systematic review. Educ. Tech. Res. Dev. 68, 1961–1990 (2020)
Al-Alawi, R., Oliver, G., Donaldson, J.F.: Systematic review: predictors of students’ success in baccalaureate nursing programs. Nurse Educ. Pract. 48, 102865 (2020)
Li, K.C., Wong, B.T.M., Chan, H.T.: Predictive analytics for university student admission: a literature review. In: Proceedings of International Conference on Blended Learning, pp. 250–259 (2023)
Wong, B.T.M., Li, K.C.: A review of learning analytics intervention in higher education (2011–2018). J. Comp. Educ. 7(1), 7–28 (2020)
Martin, F., Ritzhaupt, A., Kumar, S., Budhrani, K.: Award-winning faculty online teaching practices: course design, assessment and evaluation, and facilitation. Internet High. Educ. 42, 34–43 (2019)
Crews, T.B., Curtis, D.F.: Online course evaluations: faculty perspective and strategies for improved response rates. Assess. Eval. High. Educ. 36(7), 865–878 (2011)
Schmitt, E.M., Hu, A.C., Bachrach, P.S.: Course evaluation and assessment: examples of a learner-centered approach. Gerontol. Geriatr. Educ. 29(3), 290–300 (2008)
Jaggars, S.S., Xu, D.: How do online course design features influence student performance? Comput. Educ. 95, 270–284 (2016)
Masui, C., Broeckmans, J., Doumen, S., Groenen, A., Molenberghs, G.: Do diligent students perform better? Complex relations between student and course characteristics, study time, and academic performance in higher education. Stud. High. Educ. 39(4), 621–643 (2014)
Ahmadi, M., Helms, M.M., Raiszadeh, F.: Business students’ perceptions of faculty evaluations. Int. J. Educ. Manag. 15(1), 12–22 (2001)
Brew, L.S.: The role of student feedback in evaluating and revising a blended learning course. Internet High. Educ. 11(2), 98–105 (2008)
Steyn, C., Davies, C., Sambo, A.: Eliciting student feedback for course development: the application of a qualitative course evaluation tool among business research students. Assess. Eval. High. Educ. 44(1), 11–24 (2019)
Blair, E., Valdez Noel, K.: Improving higher education practice through student evaluation systems: is the student voice being heard? Assess. Eval. High. Educ. 39(7), 879–894 (2014)
Shapiro, H.B., Lee, C.H., Roth, N.E.W., Li, K., Çetinkaya-Rundel, M., Canelas, D.A.: Understanding the massive open online course (MOOC) student experience: an examination of attitudes, motivations, and barriers. Comput. Educ. 110, 35–50 (2017)
Milligan, C., Littlejohn, A.: Why study on a MOOC? The motives of students and professionals. Int. Rev. Res. Open Distrib. Learn. 18(2), 92–102 (2017)
Clow, D.: An overview of learning analytics. Teach. High. Educ. 18(6), 683–695 (2013)
Dawson, S.: ‘Seeing’ the learning community: an exploration of the development of a resource for monitoring online student networking. Br. J. Edu. Technol. 41(5), 736–752 (2010)
Acknowledgments
The work described in this paper was partially supported by a grant from Hong Kong Metropolitan University (CP/2022/04).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wong, B.T.M., Li, K.C., Liu, M. (2024). An Analysis of Learning Analytics Approaches for Course Evaluation. In: Ma, W.W.K., Li, C., Fan, C.W., U, L.H., Lu, A. (eds) Blended Learning. Intelligent Computing in Education. ICBL 2024. Lecture Notes in Computer Science, vol 14797. Springer, Singapore. https://doi.org/10.1007/978-981-97-4442-8_17
Download citation
DOI: https://doi.org/10.1007/978-981-97-4442-8_17
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-4441-1
Online ISBN: 978-981-97-4442-8
eBook Packages: Computer ScienceComputer Science (R0)