Abstract
This paper aims to highlight how a technologically augmented approach can help developing tonal harmony awareness in young learners. The proposal is rooted in previous experiences conducted by the same research group and dealing, on one side, with the embodiment of music concepts, and, on the other, with a reenactment of the same activities in the digital domain. To the latter goal, a publicly-available web platform containing three types of exercises has been released. In order to bridge the gap between the physical experiences and their digital counterparts, we present a methodological approach based on the adoption of augmented-reality technologies. Such a vision has driven the design and implementation of an app for mobile devices that incorporates image recognition algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
- 4.
A triad consists of three distinct notes: the so-called “root note”, an interval of either minor or major third, and an interval of perfect fifth.
- 5.
A harmonic cadence is a progression of chords that concludes a section or a piece of music.
- 6.
Open Sound Control (OSC) is a protocol for networking sound and multimedia devices for purposes such as musical performance or show control. It was originally intended for sharing music performance data, such as gestures, parameters and note sequences, between digital musical instruments.
- 7.
- 8.
BYOD stands for Bring Your Own Device.
- 9.
BVI stands for Blind or Visually Impaired.
- 10.
- 11.
- 12.
- 13.
- 14.
JSON, standing for JavaScript Object Notation, is a lightweight data-interchange format based on structured plain text.
References
Afreen, R.: Bring your own device (BYOD) in higher education: opportunities and challenges. Int. J. Emerg. Trends Technol. Comput. Sci. 3(1), 233–236 (2014)
Akeju, O., Butakov, S., Aghili, S.: Main factors and good practices for managing BYOD and IoT risks in a K-12 environment. Int. J. Internet Things Cyber-Assur. 1(1), 22–39 (2018)
Avanzini, F., Baratè, A., Cottini, M., Ludovico, L.A., Mandanici, M.: Developing music harmony awareness in young students through an augmented reality approach. In: Constantine, L., Helfert, M., Holzinger, A., Silva, H.P. (eds.) Proceedings of the 4th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2020), pp. 56–63. SCITEPRESS - Science and Technology Publications, Lda (2020). https://doi.org/10.5220/0010144700560063
Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: A computer-based approach to teach tonal harmony to young students. In: Lane, H., Uhomoibhi, J., Zvacek, S. (eds.) Proceedings of the 11th International Conference on Computer Supported Education (CSEDU 2019), vol. 1, pp. 271–279. SCITEPRESS - Science and Technology Publications, Lda (2019)
Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: Metrics for the automatic assessment of music harmony awareness in children. In: Barbancho, A.M., Barbancho, I., Peinado, A., Tardón, L.J. (eds.) Proceedings of the 16th Sound & Music Computing Conference (SMC 2019), pp. 372–379. SMC (2019)
Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: Songs in music education: design and early experimentation of a web tool for the recognition of harmonic changes. In: Csapó, B., Uhomoibhi, J. (eds.) Proceedings of the 13th International Conference on Computer Supported Education (CSEDU 2021), vol. 1, pp. 709–720. SCITEPRESS - Science and Technology Publications, Lda (2021)
Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: A web platform to foster and assess tonal harmony awareness. In: Lane, H.C., Zvacek, S., Uhomoibhi, J. (eds.) CSEDU 2019. CCIS, vol. 1220, pp. 398–417. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58459-7_19
Azuma, R.T.: A survey of augmented reality. Presence Teleoper. Virtual Environ. 6(4), 355–385 (1997)
Bigand, E.: The influence of implicit harmony, rhythm and musical training on the abstraction of “tension-relaxation schemas’’ in tonal musical phrases. Contemp. Music Rev. 9(1–2), 123–137 (1993)
Bruder, P.: Gadgets go to school: the benefits and risks of BYOD (bring your own device). Educ. Digest 80(3), 15 (2014)
Cabiria, J.: Augmenting engagement: augmented reality in education. In: Increasing Student Engagement and Retention Using Immersive Interfaces: Virtual Worlds, Gaming, and Simulation. Emerald Group Publishing Limited (2012)
Cardoza, Y., Tunks, J.: The bring your own technology initiative: an examination of teachers’ adoption. Comput. Sch. 31(4), 293–315 (2014)
Chang, A., Paz, F., Arenas, J.J., Díaz, J.: Augmented reality and usability best practices: a systematic literature mapping for educational videogames. In: 2018 IEEE Sciences and Humanities International Research Conference (SHIRCON), pp. 1–5. IEEE (2018)
Cheng, G., Guan, Y., Chau, J.: An empirical study towards understanding user acceptance of bring your own device (BYOD) in higher education. Australas. J. Educ. Technol. 32(4) (2016)
Douglas, D.B., Wilke, C.A., Gibson, J.D., Boone, J.M., Wintermark, M.: Augmented reality: advances in diagnostic imaging. Multimodal Technol. Interact. 1(4), 29 (2017)
Euler, L.: Tentamen novae theoriae musicae ex certissismis harmoniae principiis dilucide expositae. Saint Petersburg Academy (1739)
Goodkin, D.: Orff-Schulwerk in the new millennium. Music. Educ. J. 88(3), 17–23 (2001)
He, W., Zhao, L.: Exploring undergraduates’ learning engagement via BYOD in the blended learning classroom. Int. J. Inf. Educ. Technol. 10(2), 159–164 (2020)
Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: NMC Horizon Report: 2014 K-12 Edition. The New Media Consortium (2014)
Kaufmann, H., Dünser, A.: Summary of usability evaluations of an educational augmented reality application. In: Shumaker, R. (ed.) ICVR 2007. LNCS, vol. 4563, pp. 660–669. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73335-5_71
Ko, S.M., Chang, W.S., Ji, Y.G.: Usability principles for augmented reality applications in a smartphone environment. Int. J. Hum.-Comput. Interact. 29(8), 501–515 (2013)
Lai, K.W., Khaddage, F., Knezek, G.: Blending student technology experiences in formal and informal learning. J. Comput. Assist. Learn. 29(5), 414–425 (2013)
Lemos, B., Correa, A., Nascimento, M., Lopes, R.: Augmented reality musical app to support children’s musical education. J. Comput. Sci. Inf. Technol. 5(4), 121–127 (2017)
Li, W., Nee, A., Ong, S.: A state-of-the-art review of augmented reality in engineering analysis and simulation. Multimodal Technol. Interact. 1(3), 17 (2017)
Liao, C.C.Y., Cheng, H.N.H., Chang, W.-C., Chan, T.-W.: Supporting parental engagement in a BYOD (bring your own device) school. J. Comput. Educ. 4(2), 107–125 (2017). https://doi.org/10.1007/s40692-017-0085-6
Mandanici, M., Rodà, A., Canazza, S.: The Harmonic Walk: an interactive physical environment to learn tonal melody accompaniment. Adv. Multimed. 2016 (2016)
McLean, K.J.: The implementation of bring your own device (BYOD) in primary [elementary] schools. Front. Psychol. 7, 1739 (2016)
Nelson, D.: BYOD: an opportunity schools cannot afford to miss. Internet@schools 19(5), 12–15 (2012)
Ng, W.: Mobile learning: BYOD and personalised learning. In: Ng, W. (ed.) New Digital Technology in Education, pp. 171–189. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-05822-1_8
Riemann, H.: Harmony Simplified: Or the Theory of the Tonal Functions of Chords. Augener & Company (1895)
Rusiñol, M., Chazalon, J., Diaz-Chito, K.: Augmented songbook: an augmented reality educational application for raising music awareness. Multimed. Tools Appl. 77(11), 13773–13798 (2018)
Saa, P., Moscoso-Zea, O., Lujan-Mora, S.: Bring your own device (BYOD): students perception - privacy issues: a new trend in education? In: 2017 16th International Conference on Information Technology Based Higher Education and Training (ITHET), pp. 1–5. IEEE (2017)
Safar, A.H.: BYOD in higher education: a case study of Kuwait university. J. Educators Online 15(2), n2 (2018)
Seitz, J.A.: Dalcroze, the body, movement and musicality. Psychol. Music 33(4), 419–435 (2005)
Sweeny, J.: BYOD in Education. A Report for Australia and New Zealand: Nine Conversations for Successful BYOD Decision Making. Microsoft (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Avanzini, F., Baratè, A., Cottini, M., Ludovico, L.A., Mandanici, M. (2022). Learning Tonal Harmony Through Augmented Reality: Bridging the Gap Between Music Embodiment and Digital Experiences. In: Holzinger, A., Silva, H.P., Helfert, M., Constantine, L. (eds) Computer-Human Interaction Research and Applications. CHIRA 2020. Communications in Computer and Information Science, vol 1609. Springer, Cham. https://doi.org/10.1007/978-3-031-22015-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-22015-9_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22014-2
Online ISBN: 978-3-031-22015-9
eBook Packages: Computer ScienceComputer Science (R0)