Abstract
For learners, it can be difficult to imagine how to perform a complex skill from textual information found in a text-based analytic rubric. In this paper we identify three deficiencies of the text-based analytic rubric for the formative assessment of complex skills. We propose to address the text-based analytic rubric’s deficiencies by adding video modeling examples. With the resulting Video Enhanced Rubric we aim to improve the formative assessment of complex skills by fostering learner’s mental model development, feedback quality and complex skill mastery.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Panadero, E., Romero, M.: To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy. Assess. Educ. Principles Policy Pract. 21, 133–148 (2014). doi:10.1080/0969594X.2013.877872
Rusman, E., Martínez-Monés, A., Boon, J., et al.: Computer Assisted Assessment – Research into E-Assessment: Proceedings of International Conference, CAA 2014, Zeist, The Netherlands, June 30–July 1 2014. In: Kalz, M., Ras, E. (eds.), pp. 1–14. Springer International Publishing, Cham (2014)
Thijs, A., Fisser, P., van der Hoeven, M.: 21E Eeuwse Vaardigheden in Het Curriculum Van Het Funderend Onderwijs. Slo 128 (2014)
Janssen-Noordman, A.M., Van Merriënboer, J.J.G.: Innovatief Onderwijs Ontwerpen. Wolters-Noordhoff, Groningen (2002)
Van Merriënboer, J.J.G., Kester, L.: The four-component instructional design model: multimedia principles in environments for complex learning. In: The Cambridge Handbook of Multimedia Learning (2005). doi:10.1017/CBO9781139547369.007
Van Merriënboer, J.J.G., Kirschner, P.A.: Ten Steps to Complex Learning. Lawrence Erlbaum Associates Inc., New Jersey (2007)
Jonsson, A., Svingby, G.: The use of scoring rubrics: reliability, validity and educational consequences. Educ. Res. Rev. 2, 130–144 (2007). doi:10.1016/j.edurev.2007.05.002
Westera, W.: Reframing contextual learning: anticipating the virtual extensions of context 14, 201–212 (2011)
Matthews, W.J., Buratto, L.G., Lamberts, K.: Exploring the memory advantage for moving scenes. Vis. Cogn. 18, 1393–1420 (2010). doi:10.1080/13506285.2010.492706
Panadero, E., Jonsson, A.: The use of scoring rubrics for formative assessment purposes revisited: a review. Educ. Res. Rev. 9, 129–144 (2013). doi:10.1016/j.edurev.2013.01.002
Mertler, C.: Designing scoring rubrics for your classroom. Pract. Assess. Res. Eval. 7, 1–10 (2001)
Brookhart, S.M., Chen, F.: The quality and effectiveness of descriptive rubrics. Educ. Rev. 1–26 (2014). doi:10.1080/00131911.2014.929565
Reynolds-Keefer, L.: Rubric-referenced assessment in teacher preparation: an opportunity to learn by using. Pract. Assess. Res. Eval. 15, 1–9 (2010)
Andrade, H.G.: The effects of instructional rubrics on learning to write. Curr. Issues Educ. 4, 1–39 (2001)
Schamber, J.F., Mahoney, S.L.: Assesing and improving the quality of group critical thinking exhibited in the final projects of collaborative learning groups. J. Gen. Educ. 55, 103–137 (2006). doi:10.1353/jge.2006.0025
Andrade, H., Du, Y.: Student perspectives on rubric-referenced assessment. Pract. Assess. Res. Eval. 10, 1–11 (2005). doi:10.1080/02602930801955986
Good, T.L.: Two decades of research on teacher expectations: findings and future directions. J. Teach. Educ. 38, 32–47 (1987). doi:10.1177/002248718703800406
Panadero, E., Tapia, J.A., Huertas, J.A.: Rubrics and self-assessment scripts effects on self-regulation, learning and self-efficacy in secondary education. Learn. Individ. Differ. 22, 806–813 (2012). doi:10.1016/j.lindif.2012.04.007
Wolters, C.A.: Regulation of motivation: evaluating an underemphasized aspect of self-regulated learning. Educ. Psychol. 38, 189–205 (2003). doi:10.1207/S15326985EP3804_1
Kuhl, J.: A functional-design approach to motivation and self-regulation: the dynamics of personality systems and interactions. In: Handbook of Self-regulation, pp. 111–169 (2000)
Panadero, E., Romero, M., Strijbos, J.W.: The impact of a rubric and friendship on peer assessment: effects on construct validity, performance, and perceptions of fairness and comfort. Stud. Educ. Eval. 39, 195–203 (2013). doi:10.1016/j.stueduc.2013.10.005
Gary, M.S., Wood, R.E.: Mental models, decision rules, and performance heterogeneity. Strateg. Manage. J. 32, 569–594 (2011). doi:10.1002/smj.899
Kim, Y., McDonough, K.: Using pretask modelling to encourage collaborative learning opportunities. Lang. Teach. Res. 15, 183–199 (2011). doi:10.1177/1362168810388711
De Grez, L., Valcke, M., Roozen, I.: The differential impact of observational learning and practice-based learning on the development of oral presentation skills in higher education. High. Educ. Res. Dev. 33, 256–271 (2014). doi:10.1080/07294360.2013.832155
Frerejean, J., van Strien, J.L.H., Kirschner, P.A., Brand-Gruwel, S.: Completion strategy or emphasis manipulation? Task support for teaching information problem solving. Comput. Hum. Behav. 62, 90–104 (2015). doi:10.1016/j.chb.2016.03.048. Manuscript Submission
Andrade, H., Buff, C., Terry, J., et al.: Assessment-driven improvements in middle school students’ writing. Middle Sch. J. 40, 4–12 (2009)
Brookhart, S.M., Chen, F.: The quality and effectiveness of descriptive rubrics. Educ. Rev. 1911, 1–26 (2014). doi:10.1080/00131911.2014.929565
Efklides, A.: Interactions of metacognition with motivation and affect in self-regulated learning: the MASRL model. Educ. Psychol. 46, 6–25 (2011). doi:10.1080/00461520.2011.538645
Schunk, D.H., Usher, E.L.: Assessing self-efficacy for self-regulated learning. In: Handbook of Self-Regulation of Learning and Performance, pp. 282–297 (2011)
Zimmerman, B.J., Kitsantas, A.: Acquiring writing revision and self-regulatory skill through observation and emulation. J. Educ. Psychol. 94, 660–668 (2002). doi:10.1037/0022-0663.94.4.660
Van Dinther, M., Dochy, F., Segers, M.: Factors affecting students’ self-efficacy in higher education. Educ. Res. Rev. 6, 95–108 (2011). doi:10.1016/j.edurev.2010.10.003
Bandura, A.: Theoretical perspectives. In: Self-efficacy: The Exercise of Control, 604 pages. W.H. Freeman, New York (1997)
De Grez, L., Valcke, M., Roozen, I.: The impact of an innovative instructional intervention on the acquisition of oral presentation skills in higher education. Comput. Educ. 53, 112–120 (2009). doi:10.1016/j.compedu.2009.01.005
Brand-Gruwel, S., Wopereis, I., Vermetten, Y.: Information problem solving by experts and novices: analysis of a complex cognitive skill. Comput. Hum. Behav. 21, 487–508 (2005). doi:10.1016/j.chb.2004.10.005
De Grez, L., Valcke, M., Roozen, I.: The impact of goal orientation, self-reflection and personal characteristics on the acquisition of oral presentation skills. Eur. J. Psychol. Educ. 24, 293–306 (2009). doi:10.1007/BF03174762
Mayer, R.E.: Multimedia Learning, 2nd edn. Cambridge University Press, New York (2009). doi:10.1007/s13398-014-0173-7.2
Paivio, A.: Mental Representations: A Dual Coding Approach (2008). doi:10.1093/acprof:oso/9780195066661.001.0001
Ayres, P.: State-of-the-art research into multimedia learning: a commentary on mayer’s handbook of multimedia learning. Appl. Cogn. Psychol. 29, 631–636 (2015). doi:10.1002/acp.3142
Skulmowski, A., Pradel, S., Kühnert, T., et al.: Embodied learning using a tangible user interface: the effects of haptic perception and selective pointing on a spatial learning task. Comput. Educ. 92–93, 64–75 (2016). doi:10.1016/j.compedu.2015.10.011
Moreno, R., Mayer, R.: Interactive multimodal learning environments. Educ. Psychol. Rev. 19, 309–326 (2007). doi:10.1007/s10648-007-9047-2
Schweppe, J., Eitel, A., Rummer, R.: The multimedia effect and its stability over time. Learn. Instr. 38, 24–33 (2015). doi:10.1016/j.learninstruc.2015.03.001
Eitel, A., Scheiter, K.: Picture or text first? Explaining sequence effects when learning with pictures and text. Educ. Psychol. Rev. 27, 153–180 (2014). doi:10.1007/s10648-014-9264-4
Van Merriënboer, J.J.G., Kester, L.: The four-component instructional design model: multimedia principles in environment for complex learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, pp. 104–148. Cambridge University Press, New York (2014)
Acknowledgement
We would like to gratefully acknowledge the contribution of the Viewbrics project, that is funded by the practice-oriented research programme of the Netherlands Initiative for Education Research (NRO), part of The Netherlands Organisation for Scientific Research (NWO).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Ackermans, K., Rusman, E., Brand-Gruwel, S., Specht, M. (2017). A First Step Towards Synthesizing Rubrics and Video for the Formative Assessment of Complex Skills. In: Joosten-ten Brinke, D., Laanpere, M. (eds) Technology Enhanced Assessment. TEA 2016. Communications in Computer and Information Science, vol 653. Springer, Cham. https://doi.org/10.1007/978-3-319-57744-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-57744-9_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-57743-2
Online ISBN: 978-3-319-57744-9
eBook Packages: Computer ScienceComputer Science (R0)