Abstract
This paper focuses on music tangible user interfaces, namely human-computer interfaces in which a user interacts with digital information through the physical environment with music intention. Music tangible user interfaces can be employed in many scenarios, including music education for beginners, gamification approaches, musical expression for impaired users, and physical and cognitive rehabilitation. After analyzing the state of the art, we will propose a model of multidimensional taxonomy that presents multiple axes along which music tangible user interfaces can be placed. Such a model is expected to help educators, therapists, and interested users choose the best-fitting solution for their specific needs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alex, K.: Soft skills. S. Chand Publishing (2009)
Alonso, M.B., Keyson, D.V.: MusicCube: making digital music tangible. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems, pp. 1176–1179. CHI EA ’05, ACM, New York, NY, USA (2005). https://doi.org/10.1145/1056808.1056870
Amico, M.D., Ludovico, L.A.: Kibo: a MIDI controller with a tangible user interface for music education. In: International Conference on Computer Supported Education, pp. 613–619. SCITEPRESS (2020)
Baratè, A., Korsten, H., Ludovico, L.A.: A music tangible user interface for the cognitive and motor rehabilitation of elderly people. In: Proceedings of the 6th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2022), pp. 121–128. SCITEPRESS - Science and Technology Publications, Lda (2022)
Baratè, A., Korsten, H., Ludovico, L.A., Oriolo, E.: Music tangible user interfaces and vulnerable users: state of the art and experimentation. In: 5th International Conference on CHIRA 2021 and 6th International Conference on CHIRA 2022, Communications in Computer and Information Science, vol. 1882, pp. 1–25. Springer Science and Business Media Deutschland GmbH (2023). https://doi.org/10.1007/978-3-031-41962-1_1
Baratè, A., Ludovico, L.A., Malchiodi, D.: Fostering computational thinking in primary school through a LEGO®-based music notation. In: Procedia Computer Science. Knowledge-Based and Intelligent Information & Engineering Systems: Proceedings of the 21st International Conference, KES 2017, 6–8 September 2017, Marseille, France, vol. 112, pp. 1334–1344 (2017). https://doi.org/10.1016/j.procs.2017.08.018
Bauer, W., Harris, J., Hofer, M.: Music learning activity types (2012). http://activitytypes.wm.edu/MusicLearningATs-June2012.pdf. Accessed 30 Sept 2022
Costanza, E., Shelley, S.B., Robinson, J.: Introducing audio D-touch: a tangible user interface for music composition and performance. In: Proceedings of the 2003 International Conference on Digital Audio EffectsDAFx03 (01/01/03) (2003), https://eprints.soton.ac.uk/270957/
Graham, J., Hull, J.J.: iCandy: a tangible user interface for iTunes. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems, pp. 2343–2348. CHI EA ’08, ACM, New York, NY, USA (2008). https://doi.org/10.1145/1358628.1358681
Hu, C., Tung, K., Lau, L.: Music Wall: a tangible user interface using tapping as an interactive technique. In: Lee, S., Choo, H., Ha, S., Shin, I.C. (eds.) APCHI 2008. LNCS, vol. 5068, pp. 284–291. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-70585-7_32
Ishii, H.: The tangible user interface and its evolution. Commun. ACM 51(6), 32–36 (2008). https://doi.org/10.1145/1349026.1349034
Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of 1st International Conference on Tangible and Embedded Interaction, pp. 139–146 (2007)
Kim, M.J., Maher, M.L.: The impact of tangible user interfaces on designers’ spatial cognition. Hum.-Comput. Interact. 23(2), 101–137 (2008)
Kumar, V., Dargan, T., Dwivedi, U., Vijay, P.: Note Code: a tangible music programming puzzle tool. In: Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction, pp. 625–629 (2015)
Ludovico, L.A., Malchiodi, D., Zecca, L.: A multimodal LEGO®-based learning activity mixing musical notation and computer programming. In: MIE 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education, pp. 44–48. ACM, New York, NY (2017). https://doi.org/10.1145/3139513.3139519
Miotti, B., Bassani, L., Cauteruccio, E., Morandi, M.: MusicBlocks: an innovative tool for learning the foundations of music. In: CSEDU (1), pp. 475–484 (2022)
Mullett, S.: Lego beats music manipulatives (2017). https://www.letsplaykidsmusic.com/lego-beats-music-manipulatives/. Accessed 30 Sept 2022
National Coalition for Core Arts Standards Archives: what are the national core arts standards? https://www.nationalartsstandards.org/content/national-core-arts-standards. Accessed 10 May 2021
Newton-Dunn, H., Nakano, H., Gibson, J.: Block Jam: a tangible interface for interactive music. J. New Music Res. 32(4), 383–393 (2003)
Oestermeier, U., Mock, P., Edelmann, J., Gerjets, P.: LEGO Music: learning composition with bricks. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 283–286. IDC ’15, ACM, New York, NY, USA (2015). https://doi.org/10.1145/2771839.2771897
Paradiso, J.A., Hsiao, K.y., Benbasat, A.: Tangible music interfaces using passive magnetic tags. In: Proceedings of the 2001 Conference on New Interfaces for Musical Expression, pp. 1–4. NIME ’01, National University of Singapore, SGP (2001)
Pedersen, E.W., Hornbæk, K.: mixiTUI: a tangible sequencer for electronic live performances. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, pp. 223–230 (2009)
Peng, H.: Algorithm Rhythm: computational thinking through tangible music device. In: Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, pp. 401–402. TEI ’12, ACM, New York, NY, USA (2012). https://doi.org/10.1145/2148131.2148234
Potidis, S., Spyrou, T.: Spyractable: a tangible user interface modular synthesizer. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8511, pp. 600–611. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07230-2_57
Presti, G., Adriano, D., Avanzini, F., Baratè, A., Ludovico, L.A.: PhonHarp: a hybrid digital-physical musical instrument for mobile phones exploiting the vocal tract. In: AM’21: Proceedings of the 16th International Audio Mostly Conference: Sonic experiences in the era of the Internet of Sounds, pp. 276–279. ACM International Conference Proceeding Series, ACM (2021). https://doi.org/10.1145/3478384.3478413
Schiettecatte, B., Vanderdonckt, J.: AudioCubes: a distributed cube tangible interface based on interaction range for sound design. In: Proceedings 2nd International Conference on Tangible and Embedded Interaction, pp. 3–10. TEI ’08, ACM, New York, NY, USA (2008). https://doi.org/10.1145/1347390.1347394
Villafuerte, L., Markova, M., Jorda, S.: Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable. In: CHI ’12 Extended Abstracts on Human Factors in Computing Systems, pp. 745–760. CHI EA ’12, ACM, New York, NY, USA (2012). https://doi.org/10.1145/2212776.2212847
Waranusast, R., Bang-ngoen, A., Thipakorn, J.: Interactive tangible user interface for music learning. In: 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013), pp. 400–405 (2013). https://doi.org/10.1109/IVCNZ.2013.6727048
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Baratè, A., Ludovico, L.A. (2024). A Multidimensional Taxonomy Model for Music Tangible User Interfaces. In: Rudinac, S., et al. MultiMedia Modeling. MMM 2024. Lecture Notes in Computer Science, vol 14556. Springer, Cham. https://doi.org/10.1007/978-3-031-53311-2_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-53311-2_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53310-5
Online ISBN: 978-3-031-53311-2
eBook Packages: Computer ScienceComputer Science (R0)