Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education Context
<p>The Original Feedback Literacy Model by Carless and Boud [<xref ref-type="bibr" rid="B3-higheredu-01-00002">3</xref>].</p> "> Figure 2
<p>Dimensions of Feedback Literacy in the e-Assessment Context (The green portion of the figure is derived from the original feedback literacy model [<xref ref-type="bibr" rid="B3-higheredu-01-00002">3</xref>]. The yellow and blue portions of the figure are derived from the extended ecological feedback literacy model [<xref ref-type="bibr" rid="B27-higheredu-01-00002">27</xref>]. The boxes represent the contribution of the present framework in the e-Assessment context).</p> ">
Abstract
:1. Introduction
2. Feedback Literacy and Learner-Centered Framework
2.1. The Original Model of Feedback Literacy
2.2. The Ecological Model of Feedback Literacy
3. Self-Regulated Learning and Feedback Literacy
4. Dimensions of Feedback Literacy in e-Assessment
5. Enhancing Students’ Feedback Literacy in e-Assessment
6. Conclusions and Practical Implications
7. Limitations and Future Research
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
LMS | learning management system |
SRL | self-regulated learning |
References
- Watling, C.J.; Ginsburg, S. Assessment, feedback and the alchemy of learning. Med. Educ. 2019, 53, 76–85. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Boud, D. Challenges for reforming assessment: The next decade. In Proceedings of the International Virtual Meeting: Teaching, Learning & Assessment in Higher Education, Iasi, Romania, 22 November–1 December 2021. [Google Scholar]
- Carless, D.; Boud, D. The development of student feedback literacy: Enabling uptake of feedback. Assess. Eval. High. Educ. 2018, 43, 1315–1325. [Google Scholar] [CrossRef] [Green Version]
- Marriott, P.; Teoh, L.K. Using screencasts to enhance assessment feedback: Students’ perceptions and preferences. Account. Educ. 2012, 21, 583–598. [Google Scholar] [CrossRef]
- Hattie, J.; Timperley, H. The power of feedback. Rev. Educ. Res. 2007, 77, 81–112. [Google Scholar] [CrossRef] [Green Version]
- Mertens, U.; Finn, B.; Lindner, M.A. Effects of computer-based feedback on lower-and higher-order learning outcomes: A network meta-analysis. J. Educ. Psychol. 2022, 114, 1743. [Google Scholar] [CrossRef]
- Jiao, H. Enhancing students’ engagement in learning through a formative e-assessment tool that motivates students to take action on feedback. Australas. J. Eng. Educ. 2015, 20, 9–18. [Google Scholar] [CrossRef]
- Bulut, O.; Cutumisu, M.; Aquilina, A.M.; Singh, D. Effects of digital score reporting and feedback on students’ learning in higher education. Front. Educ. 2019, 4, 65. [Google Scholar] [CrossRef] [Green Version]
- Carless, D. Feedback loops and the longer-term: Towards feedback spirals. Assess. Eval. High. Educ. 2019, 44, 705–714. [Google Scholar] [CrossRef]
- Daniels, L.M.; Bulut, O. Students’ perceived usefulness of computerized percentage-only vs. descriptive score reports: Associations with motivation and grades. J. Comput. Assist. Learn. 2020, 36, 199–208. [Google Scholar] [CrossRef]
- Tripodi, N.; Feehan, J.; Wospil, R.; Vaughan, B. Twelve tips for developing feedback literacy in health professions learners. Med. Teach. 2021, 43, 960–965. [Google Scholar] [CrossRef]
- Winstone, N.E.; Carless, D. Who is feedback for? The influence of accountability and quality assurance agendas on the enactment of feedback processes. Assess. Educ. Princ. Policy Pract. 2021, 28, 261–278. [Google Scholar] [CrossRef]
- Matthews, K.E.; Tai, J.; Enright, E.; Carless, D.; Rafferty, C.; Winstone, N. Transgressing the boundaries of ‘students as partners’ and ‘feedback’ discourse communities to advance democratic education. Teach. High. Educ. 2021, 1–15. [Google Scholar] [CrossRef]
- Winstone, N.E.; Pitt, E.; Nash, R. Educators’ perceptions of responsibility-sharing in feedback processes. Assess. Eval. High. Educ. 2021, 46, 118–131. [Google Scholar] [CrossRef]
- Winstone, N.E.; Boud, D. The need to disentangle assessment and feedback in higher education. Stud. High. Educ. 2020, 47, 656–667. [Google Scholar] [CrossRef]
- Lui, A.M.; Andrade, H.L. The next black box of formative assessment: A model of the internal mechanisms of feedback processing. Front. Educ. 2022, 7, 751548. [Google Scholar] [CrossRef]
- Quigley, D. When I say ⋯ feedback literacy. Med. Educ. 2021, 55, 1121–1122. [Google Scholar] [CrossRef]
- Rovagnati, V.; Pitt, E.; Winstone, N. Feedback cultures, histories and literacies: International postgraduate students’ experiences. Assess. Eval. High. Educ. 2021, 47, 347–359. [Google Scholar] [CrossRef]
- Peytcheva-Forsyth, R.; Aleksieva, L. Forced introduction of e-assessment during covid-19 pandemic: How did the students feel about that? (Sofia university case). In In Proceedings of the AIP Conference Proceedings, Brisbane, Australia, 6–9 December 2021; Volume 2333, pp. 1–11. [Google Scholar] [CrossRef]
- Kwong, T.; Mui, L.; Wong, E.Y.W. A case study on online learning and digital assessment in times of crisis. World J. Educ. Res. 2020, 7, 44–49. [Google Scholar] [CrossRef] [Green Version]
- Alruwais, N.; Wills, G.; Wald, M. Advantages and challenges of using e-assessment. Int. J. Inf. Educ. Technol. 2018, 8, 34–37. [Google Scholar] [CrossRef]
- Akbar, M. Digital technology shaping teaching practices in higher education. Front. ICT 2016, 3. [Google Scholar] [CrossRef] [Green Version]
- Lynch, M. E-learning during a global pandemic. Asian J. Distance Educ. 2020, 15, 189–195. [Google Scholar]
- Dermo, J. E-assessment and the student learning experience: A survey of student perceptions of e-Assessment. Br. J. Educ. Technol. 2009, 40, 203–214. [Google Scholar] [CrossRef]
- Bulut, O.; Cutumisu, M.; Singh, D.; Aquilina, A.M. Guidelines for generating effective feedback from e-assessments. Hacet. Univ. J. Educ. 2020, 35, 60–72. [Google Scholar] [CrossRef]
- Jordan, S. Student engagement with assessment and feedback: Some lessons from short-answer free-text e-assessment questions. Comput. Educ. 2012, 58, 818–834. [Google Scholar] [CrossRef]
- Chong, S.W. Reconsidering student feedback literacy from an ecological perspective. Assess. Eval. High. Educ. 2021, 46, 92–104. [Google Scholar] [CrossRef]
- Winstone, N.E.; Balloo, K.; Carless, D. Discipline-specific feedback literacies: A framework for curriculum design. High. Educ. 2022, 83, 57–77. [Google Scholar] [CrossRef]
- Jensen, L.X.; Bearman, M.; Boud, D. Understanding feedback in online learning—A critical review and metaphor analysis. Comput. Educ. 2021, 173, 104271. [Google Scholar] [CrossRef]
- Molloy, E.; Boud, D.; Henderson, M. Developing a learning-centred framework for feedback literacy. Assess. Eval. High. Educ. 2020, 45, 527–540. [Google Scholar] [CrossRef] [Green Version]
- Hounsell, D. Chapter 8: Towards more sustainable feedback to students. In Rethinking Assessment in Higher Education: Learning for the Longer Term; Boud, D., Falchikov, N., Eds.; Routledge: London, UK, 2007; pp. 101–113. [Google Scholar]
- Lyle, S. Dialogic teaching: Discussing theoretical contexts and reviewing evidence from classroom practice. Lang. Educ. 2008, 22, 222–240. [Google Scholar] [CrossRef]
- Sutton, P. Towards dialogic feedback. Crit. Reflective Pract. Educ. 2009, 1, 1–10. [Google Scholar]
- Yang, M.; Carless, D. The feedback triangle and the enhancement of dialogic feedback processes. Teach. High. Educ. 2013, 18, 285–297. [Google Scholar] [CrossRef]
- Carless, D.; Winstone, N. Teacher feedback literacy and its interplay with student feedback literacy. Teach. High. Educ. 2020, 1–14. [Google Scholar] [CrossRef]
- Dawson, P.; Carless, D.; Lee, P.P.W. Authentic feedback: Supporting learners to engage in disciplinary feedback practices. Assess. Eval. High. Educ. 2021, 46, 286–296. [Google Scholar] [CrossRef]
- Butler, D.L.; Winne, P.H. Feedback and self-regulated learning: A theoretical synthesis. Rev. Educ. Res. 1995, 65, 245–281. [Google Scholar] [CrossRef]
- Malecka, B.; Boud, D. Fostering student motivation and engagement with feedback through ipsative processes. Teach. High. Educ. 2021, 1–16. [Google Scholar] [CrossRef]
- Han, Y. Written corrective feedback from an ecological perspective: The interaction between the context and individual learners. System 2019, 80, 288–303. [Google Scholar] [CrossRef]
- To, J. Using learner-centred feedback design to promote students’ engagement with feedback. High. Educ. Res. Dev. 2021, 41, 1309–1324. [Google Scholar] [CrossRef]
- Tsai, Y.S.; Mello, R.F.; Jovanović, J.; Gašević, D. Student appreciation of data-driven feedback: A pilot study on Ontask. In Proceedings of the LAK21: 11th International Learning Analytics and Knowledge Conference, Irvine, CA, USA, 12–16 April 2021; ACM: New York, NY, USA, 2021; pp. 511–517. [Google Scholar] [CrossRef]
- Chen, G.; Rolim, V.; Mello, R.F.; Gašević, D. Let’s shine together! a comparative study between learning analytics and educational data mining. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, Frankfurt am Main, Germany, 25–27 March 2020; pp. 544–553. [Google Scholar]
- Lim, L.A.; Dawson, S.; Gašević, D.; Joksimović, S.; Pardo, A.; Fudge, A.; Gentili, S. Students’ perceptions of, and emotional responses to, personalised learning analytics-based feedback: An exploratory study of four courses. Assess. Eval. High. Educ. 2021, 46, 339–359. [Google Scholar] [CrossRef]
- Pintrich, P.R. Understanding self-regulated learning. New Dir. Teach. Learn. 1995, 1995, 3–12. [Google Scholar] [CrossRef]
- Yu, S.; Liu, C. Improving student feedback literacy in academic writing: An evidence-based framework. Assess. Writ. 2021, 48, 1–11. [Google Scholar] [CrossRef]
- Panadero, E. A review of self-regulated learning: Six models and four directions for research. Front. Psychol. 2017, 8, 1–28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Evans, C. Making sense of assessment feedback in higher education. Rev. Educ. Res. 2013, 83, 70–120. [Google Scholar] [CrossRef] [Green Version]
- Fan, Y.; Saint, J.; Singh, S.; Jovanovic, J.; Gašević, D. A learning analytic approach to unveiling self-regulatory processes in learning tactics. In Proceedings of the LAK21: 11th International Learning Analytics and Knowledge Conference, Irvine, CA, USA, 12–16 April 2021; ACM: New York, NY, USA, 2021; pp. 184–195. [Google Scholar] [CrossRef]
- Forsythe, A.; Johnson, S. Thanks, but no-thanks for the feedback. Assess. Eval. High. Educ. 2017, 42, 850–859. [Google Scholar] [CrossRef]
- Han, Y.; Xu, Y. Student feedback literacy and engagement with feedback: A case study of Chinese undergraduate students. Teach. High. Educ. 2021, 26, 181–196. [Google Scholar] [CrossRef]
- Giossos, Y.; Koutsouba, M.; Lionarakis, A.; Skavantzos, K. Reconsidering moore’s transactional distance theory. Eur. J. Open Distance E-Learn. 2009, 2, 1–6. [Google Scholar]
- Prakash, L.S.; Saini, D.K. E-assessment for e-learning. In Proceedings of the 2012 IEEE International Conference on Engineering Education: Innovative Practices and Future Trends (AICERA), Kottayam, India, 19–21 July 2012; IEEE: Piscataway, NJ, USA, 2012; pp. 1–6. [Google Scholar] [CrossRef]
- Tawafak, R.M.; Romli, A.B.; Alsinani, M. E-learning system of UCOM for improving student assessment feedback in oman higher education. Educ. Inf. Technol. 2019, 24, 1311–1335. [Google Scholar] [CrossRef]
- Guo, S. Synchronous versus asynchronous online teaching of physics during the Covid-19 pandemic. Phys. Educ. 2020, 55, 1–9. [Google Scholar] [CrossRef]
- Bulut, O.; Gorgun, G.; Yildirim-Erbasli, S.N.; Wongvorachan, T.; Daniels, L.M.; Gao, Y.; Lai, K.W.; Shin, J. Standing on the shoulders of giants: Online formative assessments as the foundation for predictive learning analytics models. Br. J. Educ. Technol. 2022. [Google Scholar] [CrossRef]
- Steiner, M.; Götz, O.; Stieglitz, S. The influence of learning management system components on learners’ motivation in a large-scale social learning environment. In Proceedings of the Thirty Fourth International Conference on Information Systems, Milan, Italy, 15–18 December 2013; pp. 1–20. [Google Scholar]
- O’Donnell, F.; Sireci, S.G. Chapter 6: Score reporting issues for licensure, certification, and admission programs. In Score Reporting Research and Applications; The NCME Applications of Educational Measurement and Assessment; Routledge: London, UK, 2019; pp. 77–90. [Google Scholar]
- Adenuga, K.I.; Mbarika, V.W.; Omogbadegun, Z.O. Technical support: Towards mitigating effects of computer anxiety on acceptance of e-assessment amongst university students in sub-saharan African countries. In ICT Unbounded, Social Impact of Bright ICT Adoption; Dwivedi, Y., Ayaburi, E., Boateng, R., Effah, J., Eds.; Series Title: IFIP Advances in Information and Communication Technology; Springer International Publishing: Berlin/Heidelberg, Germany, 2019; Volume 558, pp. 48–72. [Google Scholar] [CrossRef]
- Alruwais, N.; Wills, G.; Wald, M. An evaluation of the model of acceptance of e-assessment among academics in Saudi universities. Educ. J. 2018, 7, 23–36. [Google Scholar] [CrossRef] [Green Version]
- Liu, I.F.; Chen, R.S.; Lu, H.C. An exploration into improving examinees’ acceptance of participation in an online exam. Educ. Technol. Soc. 2015, 18, 153–165. [Google Scholar]
- Wood, J. Making peer feedback work: The contribution of technology-mediated dialogic peer feedback to feedback uptake and literacy. Assess. Eval. High. Educ. 2021, 47, 327–346. [Google Scholar] [CrossRef]
- Ramaswami, M.; Bhaskaran, R. A CHAID based performance prediction model in educational data mining. IJCSI Int. J. Comput. Sci. 2010. Available online: http://xxx.lanl.gov/abs/1002.1144 (accessed on 3 April 2022).
- Tsai, Y.S. Why feedback literacy matters for learning analytics. In Proceedings of the 2022 ISLS Annual Meeting the 16th International Conference of the Learning Sciences (ICLS), Hiroshima, Japan, 21 November 2022; pp. 27–34. [Google Scholar]
- Kuklick, L.; Lindner, M.A. Computer-based knowledge of results feedback in different delivery modes: Effects on performance, motivation, and achievement emotions. Contemp. Educ. Psychol. 2021, 67, 102001. [Google Scholar] [CrossRef]
- Chen, L.; Howitt, S.; Higgins, D.; Murray, S. Students’ use of evaluative judgement in an online peer learning community. Assess. Eval. High. Educ. 2021, 47, 493–506. [Google Scholar] [CrossRef]
- Ryan, T.; Henderson, M.; Ryan, K.; Kennedy, G. Identifying the components of effective learner-centred feedback information. Teach. High. Educ. 2021, 1–18. [Google Scholar] [CrossRef]
- Desai, S.; Chin, J. An explorative analysis of the feasibility of implementing metacognitive strategies in self-regulated learning with the conversational agents. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 2020, 64, 495–499. [Google Scholar] [CrossRef]
- Pengel, N.; Martin, A.; Meissner, R.; Arndt, T.; Neumann, A.T.; de Lange, P.; Wollersheim, H.W. TecCoBot: Technology-aided support for self-regulated learning. arXiv 2021, arXiv:2111.11881. [Google Scholar]
- Winstone, N.E.; Mathlin, G.; Nash, R.A. Building feedback literacy: Students’ perceptions of the developing engagement with feedback toolkit. Front. Educ. 2019, 4, 39. [Google Scholar] [CrossRef]
- Jonsson, A. Facilitating productive use of feedback in higher education. Act. Learn. High. Educ. 2012, 14, 63–76. [Google Scholar] [CrossRef]
- Klein, C.; Lester, J.; Nguyen, T.; Justen, A.; Rangwala, H.; Johri, A. Student sensemaking of learning analytics dashboard interventions in higher education. J. Educ. Technol. Syst. 2019, 48, 130–154. [Google Scholar] [CrossRef]
- Malecka, B.; Boud, D.; Carless, D. Eliciting, processing and enacting feedback: Mechanisms for embedding student feedback literacy within the curriculum. Teach. High. Educ. 2020, 27, 908–922. [Google Scholar] [CrossRef]
- Jivet, I.; Wong, J.; Scheffel, M.; Valle Torre, M.; Specht, M.; Drachsler, H. Quantum of choice: How learners’ feedback monitoring decisions, goals and self-regulated learning skills are related. In Proceedings of the LAK21: 11th International Learning Analytics and Knowledge Conference, Irvine, CA, USA, 12–16 April 2021; ACM: New York, NY, USA, 2021; pp. 416–427. [Google Scholar] [CrossRef]
- Apampa, K.M.; Wills, G.; Argles, D. User security issues in summative e-assessment security. Int. J. Digit. Soc. (IJDS) 2010, 1, 1–13. [Google Scholar] [CrossRef]
- Reidenberg, J.R.; Schaub, F. Achieving big data privacy in education. Theory Res. Educ. 2018, 16, 263–279. [Google Scholar] [CrossRef]
- Glassey, J.; Russo Abegao, F. E-assessment and tailored feedback-are they contributing to the effectiveness of chemical engineering education? In Proceedings of the 2017 7th World Engineering Education Forum (WEEF), Kuala Lumpur, Malaysia, 13–16 November 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 508–512. [Google Scholar] [CrossRef]
- Hunt, P.; Leijen, A.; van der Schaaf, M. Automated feedback is nice and human presence makes it better: Teachers’ perceptions of feedback by means of an e-portfolio enhanced with learning analytics. Educ. Sci. 2021, 11, 278. [Google Scholar] [CrossRef]
- Fiebrink, R.; Gillies, M. Introduction to the special issue on human-centered machine learning. ACM Trans. Interact. Intell. Syst. (TIIS) 2018, 8, 1–7. [Google Scholar] [CrossRef] [Green Version]
- Khanna, M.M. Ungraded pop quizzes: Test-enhanced learning without all the anxiety. Teach. Psychol. 2015, 42, 174–178. [Google Scholar] [CrossRef]
- Kulasegaram, K.; Rangachari, P.K. Beyond “formative”: Assessments to enrich student learning. Adv. Physiol. Educ. 2018, 42, 5–14. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Appiah, M.; Van Tonder, F. E-Assessment in Higher Education: A Review. Int. J. Bus. Manag. Econ. Res. 2018, 9, 1454–1460. [Google Scholar]
- Ma, M.; Wang, C.; Teng, M.F. Using learning-oriented online assessment to foster students’ feedback literacy in l2 writing during Covid-19 pandemic: A case of misalignment between micro- and macro-contexts. Asia-Pac. Educ. Res. 2021, 30, 597–609. [Google Scholar] [CrossRef]
- Bowen, L.; Marshall, M.; Murdoch-Eaton, D. Medical student perceptions of feedback and feedback behaviors within the context of the “educational alliance”. Acad. Med. 2017, 92, 1303–1312. [Google Scholar] [CrossRef]
- Aldriye, H.; Alkhalaf, A.; Alkhalaf, M. Automated grading systems for programming assignments: A literature review. Int. J. Adv. Comput. Sci. Appl. 2019, 10, 215–222. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wongvorachan, T.; Bulut, O.; Tsai, Y.-S.; Lindner, M.A. Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education Context. Trends High. Educ. 2022, 1, 16-29. https://doi.org/10.3390/higheredu1010002
Wongvorachan T, Bulut O, Tsai Y-S, Lindner MA. Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education Context. Trends in Higher Education. 2022; 1(1):16-29. https://doi.org/10.3390/higheredu1010002
Chicago/Turabian StyleWongvorachan, Tarid, Okan Bulut, Yi-Shan Tsai, and Marlit A. Lindner. 2022. "Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education Context" Trends in Higher Education 1, no. 1: 16-29. https://doi.org/10.3390/higheredu1010002
APA StyleWongvorachan, T., Bulut, O., Tsai, Y. -S., & Lindner, M. A. (2022). Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education Context. Trends in Higher Education, 1(1), 16-29. https://doi.org/10.3390/higheredu1010002