More Web Proxy on the site http://driver.im/

research-article

Smart Mandolin and Musical Haptic Gilet: effects of vibro-tactile stimuli during live music performance

Authors:

Marcelo M. WanderleyAuthors Info & Claims

AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound

Pages 168 - 175

https://doi.org/10.1145/3356590.3356616

Published: 18 September 2019 Publication History

Abstract

In this paper we investigate the role of haptic stimuli in affecting the perception of live music. We designed a study where a smart mandolin performer played live for audience members wearing a gilet-based musical haptic wearable, which provided vibro-tactile sensations in response to the performed music. Six performances were conducted, each of which involved audiences of two people for a total of twelve participants. Results showed that the audio-haptic experience was not homogeneous across participants, who could be grouped as those appreciative of the vibrations and those less appreciative of them. The causes for a lack of appreciation of the haptic experience were mainly identified as the sensation of unpleasantness caused by the vibrations in certain parts of the body and the lack of the comprehension of the relation between what was felt and what was heard. Based on the reported results, we offer suggestions for practitioners interested in designing wearables for enriching the musical experience of audiences of live music via the sense of touch. Such suggestions point towards the need of mechanisms of personalization, systems able to minimize the latency between the sound and the vibrations, and a time of adaptation to the vibrations.

References

[1]

J. Armitage and K. Ng. 2015. Feeling Sound: Exploring a Haptic-Audio Relationship. In International Symposium on Computer Music Multidisciplinary Research. Springer, Cham, 146--152. https://doi.org/10.1007/978-3-319-46282-0_9

Digital Library

[2]

Mădălina Diaconu. 2006. Reflections on an aesthetics of touch, smell and taste. Contemporary aesthetics 4, 1 (2006), 8.

[3]

E. Frid, M. Giordano, M.M. Schumacher, and M.M. Wanderley. 2014. Physical and perceptual characterization of a tactile display for a live-electronics notification system. In Proceedings of the International Computer Music and Sound and Music Computing Joint Conference. McGill University.

[4]

E. Gunther and S. O'Modhrain. 2003. Cutaneous grooves: composing for the sense of touch. Journal of New Music Research 32, 4 (2003), 369--381. https://doi.org/10.1076/jnmr.32.4.369.18856

[5]

L. Hayes. 2015. Skin music (2012): an audio-haptic composition for ears and body. In Proceedings of the Conference on Creativity and Cognition. 359--360. https://doi.org/10.1145/2757226.2757370

Digital Library

[6]

L. Hayes and J. Rajko. 2017. Towards an Aesthetics of Touch. In Proceedings of the International Conference on Movement Computing. ACM, 22:1--22:8. https://doi.org/10.1145/3077981.3078028

Digital Library

[7]

A. Mazzoni and N. Bryan-Kinns. 2016. Mood Glove: A haptic wearable prototype system to enhance mood music in film. Entertainment Computing 17 (2016), 9--17. https://doi.org/10.1016/j.entcom.2016.06.002

[8]

J. A. McDowell and D. J. Furlong. 2018. Haptic-Listening and the Classical Guitar. In Proceedings of the Conference on New Interfaces for Musical Expression.

[9]

S. Merchel and M. E. Altinsoy. 2018. Auditory-Tactile Experience of Music. In Musical Haptics, S. Papetti and C. Saitis (Eds.). Springer, 123--148. https://doi.org/10.1007/978-3-319-58316-7_7

[10]

S. Papetti and C. Saitis (Eds.). 2018. Musical Haptics. Springer, Cham. https://doi.org/10.1007/978-3-319-58316-7

[11]

L. Turchet. 2018. Smart Mandolin: autobiographical design, implementation, use cases, and lessons learned. In Proceedings of Audio Mostly Conference. 13:1--13:7. https://doi.org/10.1145/3243274.3243280

Digital Library

[12]

L. Turchet. 2019. Smart Musical Instruments: vision, design principles, and future directions. IEEE Access 7 (2019), 8944--8963. https://doi.org/10.1109/ACCESS.2018.2876891

[13]

L. Turchet and M. Barthet. 2018. Demo of interactions between a performer playing a Smart Mandolin and audience members using Musical Haptic Wearables. In Proceedings of the Conference on New Interfaces for Musical Expression. 82--83.

[14]

L. Turchet and M. Barthet. 2019. Co-design of Musical Haptic Wearables for electronic music performer's communication. IEEE Transactions on Human-Machine Systems 49, 2 (2019), 183--193. https://doi.org/10.1109/THMS.2018.2885408

[15]

L. Turchet, C. Fischione, G. Essl, D. Keller, and M. Barthet. 2018. Internet of Musical Things: Vision and Challenges. IEEE Access 6 (2018), 61994--62017. https://doi.org/10.1109/ACCESS.2018.2872625

[16]

T.J. West, A. Bachmayer, S. Bhagwati, J. Berzowska, and M. M. Wanderley. 2019. The design of the body::suit::score, a full-body vibrotactile musical score. In Human Interface and the Management of Information. Information in Intelligent Systems, S. Yamamoto and H. Mori (Eds.). HCII 2019. Lecture Notes in Computer Science, Vol. 11570. Springer-Verlag, Cham, 70--89. https://doi.org/10.1007/978-3-030-22649-7_7

Digital Library

Cited By

Jeon JLee C(2023)SoundMist: Novel Interface for Spatial Auditory ExperienceAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616622(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3616622
Seiça MRoque LMartins PCardoso FGroß-Vogt KHöldrich R(2020)Contrasts and similarities between two audio research communities in evaluating auditory artefactsProceedings of the 15th International Audio Mostly Conference10.1145/3411109.3411146(183-190)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3411109.3411146
Capra OBerthaut FGrisoni LWakkary RAndersen KOdom WDesjardins APetersen M(2020)Have a SEAT on StageProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395492(695-707)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395492
Show More Cited By

Index Terms

Smart Mandolin and Musical Haptic Gilet: effects of vibro-tactile stimuli during live music performance

Recommendations

Haptification of performer's control gestures in live electronic music performance
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound

In this paper, we introduce musical haptic wearables for audiences (MHWAs) which provide sensing and haptic stimulation technologies for networked musical interaction using wireless connectivity. We report on a concert experiment during which audience ...
Musical Haptic Wearables for Synchronisation of Visually-impaired Performers: a Co-design Approach
IMX '21: Proceedings of the 2021 ACM International Conference on Interactive Media Experiences

The emergence of new technologies is providing opportunities to develop novel solutions that facilitate the integration of visually-impaired people in different activities of our daily life, including collective music making. This paper presents a ...
Touching the audience: musical haptic wearables for augmented and participatory live music performances
Abstract
This paper introduces the musical haptic wearables for audiences (MHWAs), a class of wearable devices for musical applications targeting audiences of live music performances. MHWAs are characterized by embedded intelligence, wireless connectivity ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound

September 2019

310 pages

ISBN:9781450372978

DOI:10.1145/3356590

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

The University of Nottingham: The University of Nottingham

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

H2020 Marie Sk?odowska-Curie Actions

Conference

AM'19

AM'19: Audio Mostly

September 18 - 20, 2019

Nottingham, United Kingdom

Acceptance Rates

AM '19 Paper Acceptance Rate 25 of 49 submissions, 51%;

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
174
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jeon JLee C(2023)SoundMist: Novel Interface for Spatial Auditory ExperienceAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616622(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3616622
Seiça MRoque LMartins PCardoso FGroß-Vogt KHöldrich R(2020)Contrasts and similarities between two audio research communities in evaluating auditory artefactsProceedings of the 15th International Audio Mostly Conference10.1145/3411109.3411146(183-190)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3411109.3411146
Capra OBerthaut FGrisoni LWakkary RAndersen KOdom WDesjardins APetersen M(2020)Have a SEAT on StageProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395492(695-707)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395492
Turchet LAntoniazzi FViola FGiunchiglia FFazekas G(2020)The Internet of Musical Things OntologyWeb Semantics: Science, Services and Agents on the World Wide Web10.1016/j.websem.2020.10054860:COnline publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1016/j.websem.2020.100548
Turchet LWest TWanderley M(2020)Touching the audience: musical haptic wearables for augmented and participatory live music performancesPersonal and Ubiquitous Computing10.1007/s00779-020-01395-225:4(749-769)Online publication date: 24-Mar-2020
https://dl.acm.org/doi/10.1007/s00779-020-01395-2
Dalsgaard TSchneider O(undefined)A Unified Model for Haptic ExperienceACM Transactions on Computer-Human Interaction10.1145/3711842
https://dl.acm.org/doi/10.1145/3711842

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten