Abstract
Increasingly accessible gesture-based interfaces offer powerful but underexplored potential for facilitating inclusive and engaging learning experiences. In this work, we explore creating and testing a hand and body pose-based gestural control interface for playing Minecraft. This work aims to be a starting point for making Minecraft (and other video games) based learning and play more inclusive and engaging by moving away from just keyboard-mouse controls. We study the viability and user-friendliness of our initial designs through surveys, interviews, and early co-design sessions, shaping gestures that resonate with diverse youth, enriching the learning and assessment of spatial cognition skills among them.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Atit, K., Gagnier, K., Shipley, T.: Student gestures aid penetrative thinking. J. Geosci. Educ. 63, 66–72 (2015). https://doi.org/10.5408/14-008.1
Cai, Y., Goei, S.L., Trooster, W. (eds.): Simulation and Serious Games for Education. GMSE, Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-0861-0
Cezarotto, M. A., Chamberlin, B.: Towards accessibility in educational games: a framework for the design team. In: InfoDesign-Revista Brasileira de Design da Informação, vol. 18(2) (2021)
Clifton, P.G., et al.: Design of embodied interfaces for engaging spatial cognition. Cogn. Res.: Principles Implications 1(1), 1–15 (2016). https://doi.org/10.1186/s41235-016-0032-5
Morsella, E., Krauss, R.M.: The role of gestures in spatial working memory and speech. Am. J. Psychol. 117(3), 411–424 (2004). https://doi.org/10.2307/4149008
Freina, L., Ott, M.: A literature review on immersive virtual reality in education: state of the art and perspectives. In: The International Scientific Conference Elearning and Software for Education, vol. 1, no. 133, pp. 1000–1007 (2015)
Guay, R.B., McDaniel, E.D.: The Purdue spatial visualization tests: a brief history. Educ. Psychol. Measur. 37(2), 391–397 (1977)
Kangas, M.: Creative and playful learning: learning through game co-creation and games in a playful learning environment. Thinking Skills Creative 5(1), 1–15 (2010)
Koumoutsakis, T., et al.: Gesture in Instruction: evidence from live & video lessons (2016)
Ma, F., Song, F., Liu, Y., Niu, J.: Quantitative analysis on the interaction fatigue of natural gestures. IEEE Access 8, 190797–190811 (2020)
Shepard, R.N., Metzler, J.: Mental rotation of three-dimensional objects. Science 171(3972), 701–703 (1971)
Skulmowski, A., Rey, G.D.: Embodied learning: introducing a taxonomy based on bodily engagement and task integration. Cogn. Res. 3, 6 (2018). https://doi.org/10.1186/s41235-018-0092-9
Subrahmanyam, K., Greenfield, P.M.: Effect of video game practice on spatial skills in girls and boys. J. Appl. Dev. Psychol. 15(1), 13–32 (1994)
Wang, L.H., Chen, B., Hwang, G.J., Guan, J.Q., Wang, Y.Q.: Effects of digital game-based STEM education on students’ learning achievement: a meta-analysis. Int. J. STEM Educ. 9(1), 1–13 (2022)
Worsley, M., Bar-El, D.: Spatial reasoning in minecraft: an exploratory study of in-game spatial practices. In: Computer Supported Collaborative Learning, 2 (2020)
Zhonggen, Y.: A meta-analysis of use of serious games in education over a decade. Int. J. Comput. Games Technol. (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Issa, J., Kumar, V., Worsley, M. (2024). Spatial Cognition Through Gestural Interfaces: Embodied Play and Learning with Minecraft. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies. HCII 2024. Lecture Notes in Computer Science, vol 14723. Springer, Cham. https://doi.org/10.1007/978-3-031-61685-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-61685-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-61684-6
Online ISBN: 978-3-031-61685-3
eBook Packages: Computer ScienceComputer Science (R0)