Abstract
The research landscape displays increasing awareness of the important role of self-regulation and emotions in the process of acquiring Collaborative Problem-Solving skills (CPS), which are considered essential in almost all areas of life. However, there is still a dearth of research on developing CPS skills among elementary-school students. Our research therefore looks at how elementary school students' regulation skills and emotions are supported by a collaborative game using a collaboration script to scaffold group awareness. An intervention was carried out with a sample of 223 students aged between 10 and 13. The experimental group worked collaboratively in sub-groups, scaffolded by the game, while the control group attended regular lessons. The students’ attitudes towards collaboration were evaluated before and after the intervention. In addition to this, a focus group was held a week after the intervention, which involved 32 students from both groups. The quantitative analysis revealed that attitudes towards collaboration improved significantly among students in the experimental group. This difference can be explained by a combination of the intervention, the students’ initial attitudes, and their respective GPAs. The qualitative analysis provided evidence of the regulation processes and emotions that emerge when combining a collaboration script with group awareness tools during CPS activities. Furthermore, the results highlighted the relationship between these tools and positive emotions (i.e., satisfaction), co-regulation, and shared regulation. These findings suggest that there is a relationship between the co-regulation process required by the game and a shift in emotions from frustration to satisfaction. This work provides evidence of how scaffolding group awareness using a collaboration script supports regulation skills and emotions, thus promoting the development of Collaborative Problem-Solving skills.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and material
The datasets generated during and/or analysed during the current study are available from the corresponding author on request.
Code availability
The code generated during the current study are available from the corresponding author on request.
References
Axelrod, R., & Hamilton, W. D. (1981). The Evolution of Cooperation. Science, 211(4489), 1390–1396.
Bodemer, D., & Dehler, J. (2011). Group awareness in CSCL environments. Computers in Human Behavior, 27(3), 1043–1045.
Bødker, S., & Christiansen, E. (2006). Computer support for social awareness in flexible work. Computer Supported Cooperative Work (CSCW), 15(1), 1–28.
Buono, S., Zdravkovic, A., Lazic, M., & Woodruff, E. (2020). The effect of emotions on self-regulated-learning (SRL) and story comprehension in emerging readers. In Frontiers in Education (Vol. 5, p. 218). Frontiers.
Calvo-Morata, A., Alonso-Fernández, C., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2020). Serious games to prevent and detect bullying and cyberbullying: A systematic serious games and literature review. Computers & Education, 157, 103958.
Camacho-Morles, J., Slemp, G. R., Oades, L. G., Morrish, L., & Scoular, C. (2019). The role of achievement emotions in the collaborative problem-solving performance of adolescents. Learning and Individual Differences, 70, 169–181.
Chavez, J., & Romero, M. (2012). Group awareness, learning, and participation in Computer Supported Collaborative Learning (CSCL). Procedia-Social and Behavioral Sciences, 46, 3068–3073.
Chen, C. H., & Law, V. (2016). Scaffolding individual and collaborative game-based learning in learning performance and intrinsic motivation. Computers in Human Behavior, 55, 1201–1212.
Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122.
Costikyan, G. (2013). Uncertainty in games. Mit Press.
Csikszentmihalyi, M. (1991). Flow: The psychology of optimal experience In: New York: HarperPerennial.
Dehler, J., Bodemer, D., Buder, J., & Hesse, F. W. (2011). Guiding knowledge communication in CSCL via group knowledge awareness. Computers in Human Behavior, 27(3), 1068–1078.
Dillenbourg, P. (1999). What do you mean by collaborative leraning? In P. Dillenbourg (Ed.), Collaborative-learning: Cognitive and Computational Approaches (pp. 1–19). Elsevier.
Dillenbourg, P. (2002). Over-scripting CSCL: The risks of blending collaborative learning with instructional design.
Dillenbourg, P., & Jermann, P. (2007). Designing integrative scripts. In Scripting computer-supported collaborative learning (pp. 275–301). Springer, Boston, MA.
Dillenbourg, P., Järvelä, S., & Fischer, F. (2009). The evolution of research on computer-supported collaborative learning. In Technology-enhanced learning (pp. 3–19). Springer, Dordrecht.
Dindar, M., Järvelä, S., & Järvenoja, H. (2020). Interplay of metacognitive experiences and performance in collaborative problem solving. Computers & Education, 154, 103922.
Domagk, S., Schwartz, R. N., & Plass, J. L. (2010). Interactivity in multimedia learning: An integrated model. Computers in Human Behavior, 26(5), 1024–1033.
Fiore, S. M., Graesser, A., & Greiff, S. (2018). Collaborative problem-solving education for the twenty-first-century workforce. Nature Human Behaviour, 2(6), 367.
Fischer, F., Kollar, I., Stegmann, K., Wecker, C., & Zottmann, J. (2013). Collaboration scripts in computer-supported collaborative learning. In The international handbook of collaborative learning (pp. 415–431). Routledge. https://doi.org/10.4324/9780203837290.ch23
Funke, J., Fischer, A., & Holt, D. V. (2018). Competencies for complexity: problem solving in the twenty-first century. In Assessment and teaching of 21st century skills (pp. 41–53). Springer, Cham.
Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018). Advancing the Science of Collaborative Problem Solving. Psychological Science in the Public Interest, 19(2), 59–92.
Griffin, P., & Care, E. (Eds.). (2014). Assessment and teaching of 21st century skills: Methods and approach. Springer.
Gutwin, C., & Greenberg, S. (2004). The importance of awareness for team cognition in distributed collaboration. In E. Salas & S. M. Fiore (Eds.), Team cognition: Understanding the factors that drive process and performance (pp. 177–201). American Psychological Association.
Hadwin, A., Bakhtiar, A., & Miller, M. (2018a). Challenges in online collaboration: Effects of scripting shared task perceptions. International Journal of Computer-Supported Collaborative Learning, 13(3), 301–329.
Hadwin, A., Järvelä, S., & Miller, M. (2018b). Self-regulation, co-regulation, and shared regulation in collaborative learning environments. In D.H. Schunk, J.A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed.), Routledge, New York (2018b), pp. 83–106.
Hawlitschek, A., & Joeckel, S. (2017). Increasing the effectiveness of digital educational games: The effects of a learning instruction on students’ learning, motivation and cognitive load. Computers in Human Behavior, 72, 79–86.
Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015). A framework for teachable collaborative problem solving skills. In Assessment and teaching of 21st century skills (pp. 37–56). Springer, Dordrecht.
Huizinga, J. (2014). Homo ludens ils 86. Routledge.
Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013). A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Computers & Education, 69, 121–130.
Isohätälä, J., Näykki, P., & Järvelä, S. (2020). Cognitive and socio-emotional interaction in collaborative learning: Exploring fluctuations in students’ participation. Scandinavian Journal of Educational Research, 64(6), 831–851.
Janssen, J., & Bodemer, D. (2013). Coordinated computer-supported collaborative learning: Awareness and awareness tools. Educational Psychologist, 48(1), 40–55.
Janssen, J., Erkens, G., & Kirschner, P. A. (2011). Group awareness tools: It’s what you do with it that matters. Computers in Human Behavior, 27(3), 1046–1105.
Janssen, J., Erkens, G., Kanselaar, G., & Jaspers, J. (2007). Visualization of participation: Does it contribute to successful computer-supported collaborative learning? Computers & Education, 49(4), 1037–1065.
Järvelä, S., & Hadwin, A. F. (2013). New frontiers: Regulating learning in CSCL. Educational Psychologist, 48(1), 25–39.
Järvelä, S., Järvenoja, H., Malmberg, J., & Hadwin, A. F. (2013). Exploring socially shared regulation in the context of collaboration. Journal of Cognitive Education and Psychology, 12(3), 267–286.
Järvelä, S., Kirschner, P. A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., & Järvenoja, H. (2015). Enhancing socially shared regulation in collaborative learning groups: Designing for CSCL regulation tools. Educational Technology Research and Development, 63(1), 125–142.
Järvenoja, H., Järvelä, S., & Malmberg, J. (2020). Supporting groups’ emotion and motivation regulation during collaborative learning. Learning and Instruction, 70, 101090. https://doi.org/10.1016/j.learninstruc.2017.11.004
Järvenoja, H., Näykki, P., & Törmänen, T. (2019). Emotional regulation in collaborative learning: When do higher education students activate group level regulation in the face of challenges? Studies in Higher Education, 44(10), 1747–1757.
Johnson, D. W., & Johnson, R. T. (1999). Making cooperative learning work. Theory into Practice, 38(2), 67–73.
Juul, J. (2013). The art of failure: An essay on the pain of playing video games. MIT press.
Kiili, K., De Freitas, S., Arnab, S., & Lainema, T. (2012). The design principles for flow experience in educational games. Procedia Computer Science, 15, 78–91.
Li, Y., Li, X., Zhang, Y., & Li, X. (2021). The effects of a group awareness tool on knowledge construction in computer-supported collaborative learning. British Journal of Educational Technology, 52, 1178–1196. https://doi.org/10.1111/bjet.13066
Lim, J. Y., & Lim, K. Y. (2020). Co-regulation in collaborative learning: Grounded in achievement goal theory. International Journal of Educational Research, 103, 101621.
Loderer, K., Pekrun, R., & Plass, J. L. (2020). Emotional foundations of game-based learning. In J. L. Plass, R. E. Mayer, & B. D. Homer (Eds.), Handbook of game-based learning (pp. 111–151). The MIT Press.
Lyons, K. M., Lobczowski, N. G., Greene, J. A., Whitley, J., & McLaughlin, J. E. (2021). Using a design-based research approach to develop and study a web-based tool to support collaborative learning. Computers & Education, 161, 104064.
Ma, X., Liu, J., Liang, J., & Fan, C. (2020). An empirical study on the effect of group awareness in CSCL environments. Interactive Learning Environments. https://doi.org/10.1080/10494820.2020.1758730
Maine, F. (2017). Collaborative and dialogic meaning-making: How children engage and immerse in the storyworld of a mobile game. In The Case of the iPad (pp. 211–225). Springer, Singapore.
Malmberg, J., Järvelä, S., & Järvenoja, H. (2017). Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology, 49, 160–174.
Mänty, K., Järvenoja, H., & Törmänen, T. (2020). Socio-emotional interaction in collaborative learning: Combining individual emotional experiences and group-level emotion regulation. International Journal of Educational Research, 102, 101589.
Mayer, R. E. (2014). Computer games for learning: An evidence-based approach. MIT Press.
McAlister, A., Lee, D., Ehlert, K. M., Kajfez, R. L., Faber, C. J., & Kennedy, M. S. (2017). Qualitative coding: An approach to assess inter-rater reliability. In American Society for Engineering Education (pp. 5–9).
Miller, M., & Hadwin, A. (2015). Scripting and awareness tools for regulating collaborative learning: Changing the landscape of support in CSCL. Computers in Human Behavior, 52, 573–588.
Näykki, P., Isohätälä, J., Järvelä, S., Pöysä-Tarhonen, J., & Häkkinen, P. (2017). Facilitating socio-cognitive and socio-emotional monitoring in collaborative learning with a regulation macro script–an exploratory study. International Journal of Computer-Supported Collaborative Learning, 12(3), 251–279.
Noroozi, O., Järvelä, S., & Kirschner, P. A. (2019). Multidisciplinary innovations and technologies for facilitation of self-regulated learning. Computers in Human Behavior, 100, 295–297. https://doi.org/10.1016/J.CHB.2019.07.020
Noroozi, O., Teasley, S. D., Biemans, H. J., Weinberger, A., & Mulder, M. (2013). Facilitating learning in multidisciplinary groups with transactive CSCL scripts. International Journal of Computer-Supported Collaborative Learning, 8(2), 189–223.
Nussbaum, M., Alvarez, C., McFarlane, A., Gomez, F., Claro, S., & Radovic, D. (2009). Technology as small group face-to-face Collaborative Scaffolding. Computers & Education, 52(1), 147–153.
ØDegård, A. (2006). Exploring perceptions of interprofessional collaboration in child mental health care. International Journal of Integrated Care, 6(4). https://doi.org/10.5334/ijic.165
OECD. (2017). Pisa 2015 Collaborative Problem Solving Framework. Retrieved from https://www.oecd.org/pisa/pisaproducts/DraftPISA2015CollaborativeProblemSolvingFramework.pdf
OECD. (2018). PISA 2015: Results in focus. PISA, 67, 16.
Parker, P. C., Perry, R. P., Hamm, J. M., Chipperfield, J. G., Pekrun, R., Dryden, R. P., & Tze, V. M. (2021). A motivation perspective on achievement appraisals, emotions, and performance in an online learning environment. International Journal of Educational Research, 108, 101772.
Pekrun, R. (2017). Achievement emotions. Emotions in Late Modernity, 142.
Pifarré, M., Cobos, R., & Argelagós, E. (2014). Incidence of group awareness information on students’ collaborative learning processes. Journal of Computer Assisted Learning, 30(4), 300–317.
Plass, J., Homer, B., & Kinzer, C. (2015). Foundations of Game-Based Learning. Educational Psychologist, 50(4), 258–283.
Popov, V., Biemans, H. J., Fortuin, K. P., van Vliet, A. J., Erkens, G., Mulder, M., & Li, Y. (2019). Effects of an interculturally enriched collaboration script on student attitudes, behavior, and learning performance in a CSCL environment. Learning, Culture and Social Interaction, 21, 100–123.
Qian, M., & Clark, K. R. (2016). Game-based Learning and 21st century skills: A review of recent research. Computers in Human Behavior, 63, 50–58.
Quinn, C. N. (2005). Engaging learning: Designing e-learning simulation games. John Wiley & Sons.
R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, version 4.0.2. URL https://www.R-project.org/
Radkowitsch, A., Vogel, F., & Fischer, F. (2020). Good for learning, bad for motivation? A meta-analysis on the effects of computer-supported collaboration scripts. International Journal of Computer-Supported Collaborative Learning, 15(1), 5–47.
Rau, M. A., Bowman, H. E., & Moore, J. W. (2017). An adaptive collaboration script for learning with multiple visual representations in chemistry. Computers & Education, 109, 38–55.
Reis, R. C. D., Isotani, S., Rodriguez, C. L., Lyra, K. T., Jaques, P. A., & Bittencourt, I. I. (2018). Affective states in computer-supported collaborative learning: Studying the past to drive the future. Computers and Education, 120(February), 29–50. https://doi.org/10.1016/j.compedu.2018.01.015
Rocha, J. B., Mascarenhas, S., and Prada, R. 2008. “Game Mechanics for Cooperative Games,” in ZON Digital Games, N. Zagalo & R. Prada (eds.), Universidade do Minho, pp. 72–80. https://doi.org/10.1523/JNEUROSCI.1920-10.2010
Rojas, M., Nussbaum, M., Chiuminatto, P., Guerrero, O., Greiff, S., Krieger, F., & Van Der Westhuizen, L. (2021). Assessing collaborative problem-solving skills among elementary school students. Computers & Education, 175, 104313.
Rosen, Y., Wolf, I., & Stoeffler, K. (2020). Fostering collaborative problem solving skills in science: The Animalia project. Computers in Human Behavior, 104, 105922.
Schnaubert, L., Vogel, F., Bodemer, D., Fischer, F., Radkowitsch, A., Schmidmaier, R., Fischer, M. R., Tsovaltzi, D., Puhl, T., & Azevedo, R. (2020). Combining Scripts, Group Awareness Tools and Self-Regulated Learning – Theoretical Implications and Practical Implementations. In M. Gresalfi & I. S. Horn (Eds.), The Interdisciplinarity of the Learning Sciences, 14th International Conference of the Learning Sciences (ICLS) 2020 (Vol. 1, pp. 350–357). International Society of the Learning Sciences.
Schunk, D. H., & Zimmerman, B. J. (2008). Motivation and self-regulated learning: Theory, research, and applications. Lawrence Erlbaum Associates Publishers.
Scoular, C., & Care, E. (2018). Teaching twenty-first century skills: implications at system levels in Australia. In Assessment and Teaching of 21st Century Skills (pp. 145–162). Springer, Cham.
Scoular, C., Care, E., & Hesse, F. W. (2017). Designs for operationalizing collaborative problem solving for automated assessment. Journal of Educational Measurement, 54(1), 12–35.
Seif El-Nasr, M., Aghabeigi, B., Milam, D., Erfani, M., Lameman, B., Maygoli, H., & Mah, S. (2010, April). Understanding and evaluating cooperative games. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 253–262).
Slavin, R. E. (1996). Research on cooperative learning and achievement: What we know, what we need to know. Contemporary Educational Psychology, 21(1), 43–69.
Splichal, J. M., Oshima, J., & Oshima, R. (2018). Regulation of collaboration in project-based learning mediated by CSCL scripting reflection. Computers & Education, 125, 132–145.
Sun, C., Shute, V. J., Stewart, A., Yonehiro, J., Duran, N., & D'Mello, S. (2020). Towards a generalized competency model of collaborative problem solving. Computers & Education, 143, 103672.
Szewkis, E., Nussbaum, M., Rosen, T., Abalos, J., Denardin, F., Caballero, D., & Alcoholado, C. (2011). Collaboration within large groups in the classroom. International Journal of Computer-Supported Collaborative Learning, 6(4), 561–575.
Tang, P., Liu, H., & Wen, H. (2021, April). Factors Predicting Collaborative Problem Solving: Based on the Data from PISA 2015. In Frontiers in Education (Vol. 6, p. 130). Frontiers.
Teruel, M. A., Condori-Fernandez, N., Navarro, E., González, P., & Lago, P. (2018). Assessing the impact of the awareness level on a co-operative game. Information and Software Technology, 98, 89–116.
Travis, J., & Bunde, J. (2020). Self-regulation in college: The influence of self-efficacy, need satisfaction, and stress on GPA, persistence, and satisfaction. Current Psychology. https://doi.org/10.1007/s12144-020-01091-7
Tyack, A., Wyeth, P., & Johnson, D. (2020, April). Restorative play: Videogames improve player wellbeing after a need-frustrating event. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–15).
Van der Meij, H., Veldkamp, S., & Leemkuil, H. (2020). Effects of scripting on dialogues, motivation and learning outcomes in serious games. British Journal of Educational Technology, 51(2), 459–472.
Vogel, F., Weinberger, A., & Fischer, F. (2021). Collaboration scripts: Guiding, internalizing, and adapting. In International Handbook of Computer-Supported Collaborative Learning (pp. 335–352). Springer, Cham.
Von Davier, A. A., Hao, J., Liu, L., & Kyllonen, P. (2017). Interdisciplinary research agenda in support of assessment of collaborative problem solving: Lessons learned from developing a collaborative science assessment prototype. Computers in Human Behavior, 76, 631–640.
Webster, E. A., & Hadwin, A. F. (2015). Emotions and emotion regulation in undergraduate studying: Examining students’ reports from a self-regulated learning perspective. Educational Psychology, 35(7), 794–818.
Yilmaz, R., & Yilmaz, F. G. K. (2020). Examination of the effectiveness of the task and group awareness support system used for computer-supported collaborative learning. Educational Technology Research and Development, 1–26(68), 1355–1380.
Zimmerman, B. J. (2013). From cognitive modeling to self-regulation: A social cognitive career path. Educational Psychologist, 48(3), 135–147.
Zimmerman, B. J., & Schunk, D. H. (2011). Self-regulated learning and performance: An introduction and an overview. Handbook of self-regulation of learning and performance, 15–26.
Acknowledgements
This work was supported by Fondo Nacional de Desarrollo Científico y Tecnológico / Agencia Nacional de Investigación y Desarrollo [FONDECYT 1180024].
Funding
This work was supported by Fondo Nacional de Desarrollo Científico y Tecnológico / Agencia Nacional de Investigación y Desarrollo [FONDECYT 1180024].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The ethical committee of Universidad Católica de Chile approved this project under number 170614006.
Consent to participate
Informed consent was obtained from all individual participants included in the study and their respective legal guardians.
Consent for publication
The participant and their legal guardians have consented to the submission of the case report to the journal.
Conflicts of interest/Competing interests
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A
Game Chracteristics
Appendix B
Qualitative Method
See Table 9.
Appendix C
Design Considerations
See: https://zenodo.org/record/6010420/files/Appendix%20C.pdf?download=1
Appendix D
Stages of the Game
See: https://zenodo.org/record/6010420/files/Appendix%20D.pdf?download=1
Appendix E
Game Tasks
See: https://zenodo.org/record/6010420/files/Appendix%20E.pdf?download=1
Appendix F
Focus group interview guidelines
See: https://zenodo.org/record/6010420/files/Appendix%20F.pdf?download=1
Appendix G
Attitude toward collaboration scale
See: https://zenodo.org/record/6010420/files/Appendix%20G.pdf?download=1
Appendix H
Qualitative Results
See: https://zenodo.org/record/6010420/files/Appendix%20H.pdf?download=1
Rights and permissions
About this article
Cite this article
Rojas, M., Nussbaum, M., Guerrero, O. et al. Integrating a collaboration script and group awareness to support group regulation and emotions towards collaborative problem solving. Intern. J. Comput.-Support. Collab. Learn 17, 135–168 (2022). https://doi.org/10.1007/s11412-022-09362-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11412-022-09362-0