More Web Proxy on the site http://driver.im/

research-article

Open access

Encumbered Interaction: a Study of Musicians Preparing to Perform

Authors:

Juan Pablo Martinez Avila,

Chris Greenhalgh,

Adrian Hazzard,

Alan ChamberlainAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 476, Pages 1 - 13

https://doi.org/10.1145/3290605.3300706

Published: 02 May 2019 Publication History

All formats PDF

Abstract

Guitars are physical instruments that require skillful two-handed use. Their use is also supported by diverse digital and physical resources, such as videos and chord charts. To understand the challenges of interacting with supporting resources at the same time as playing we conducted an ethnographic study of the preparation activities of working musicians. We observe successive stages of individual and collaborative preparation, in which working musicians engage with a diverse range of digital and physical resources to support their preparation. Interaction with this complex ecology of digital and physical resources is finely interwoven into their embodied musical practices, which are usually encumbered by having their instrument in hand, and often by playing. We identify challenges for augmenting guitars within the rehearsal process by supporting interaction that is encumbered, contextual and connected, and suggest a range of possible responses.

Supplementary Material

MP4 File (paper476p.mp4)

Preview video

Download
3.24 MB

MP4 File (paper476.mp4)

Download
221.25 MB

References

[1]

Ahmed Ahmed, Steve Benford, and Andy Crabtree. 2012. Digging in the crates: an ethnographic study of DJS'work. In Proceedings of the SIGCHI conference on human factors in computing systems, 1805-- 1814.

Digital Library

[2]

Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2014. From "smart objects" to "social objects": The next evolutionary step of the internet of things. IEEE Communications Magazine 52, 1: 97-- 105. https://doi.org/10/gd7d7m

[3]

Steve Benford, Adrian Hazzard, Alan Chamberlain, Kevin Glover, Chris Greenhalgh, Liming Xu, Michaela Hoare, and Dimitrios Darzentas. 2016. Accountable artefacts: the case of the Carolan guitar. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 1163--1175.

Digital Library

[4]

Steve Benford, Adrian Hazzard, Alan Chamberlain, and Liming Xu. 2015. Augmenting a Guitar with Its Digital Footprint. In Proceedings of the international conference on New Interfaces for Musical Expression (NIME 2015). The School of Music and the Center for Computation and Technology (CCT), Louisiana State University, Baton Rouge, Louisiana, USA, 303--306.

Digital Library

[5]

Steve Benford, Peter Tolmie, Ahmed Y. Ahmed, Andy Crabtree, and Tom Rodden. 2012. Supporting traditional music-making: designing for situated discretion. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 127--136.

Digital Library

[6]

Nicolas Bouillot, Michael Wozniewski, Zack Settel, and Jeremy R. Cooperstock. 2008. A Mobile Wireless Augmented Guitar. In Proceedings of the 2008 New Interfaces for Musical Expression Conference (NIME), 189--192.

[7]

John Seely Brown and Paul Duguid. 2000. The Social Life of Information (Book Review). Harvard Business Review 78, 6: 194--194.

Digital Library

[8]

Anne-Marie Burns, Sébastien Bel, and Caroline Traube. 2017. Learning to play the guitar at the age of interactive and collaborative Web technologies. In Proceedings of the 14th Sound and Music Computing Conference, July 5--8, Espoo, Finland.

[9]

Andrew Crabtree, Mark Rouncefield, and Peter Tolmie. 2012. Doing design ethnography. Springer.

[10]

Anind K. Dey, Gregory D. Abowd, and Daniel Salber. 2001. A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-aware Applications. Human-Computer Interaction. 16, 2: 97--166. https://doi.org/10/b3ww6m

Digital Library

[11]

Paul Dourish. 2004. What we talk about when we talk about context. Personal and ubiquitous computing 8, 1: 19--30. https://doi.org/10/cfdfd6

[12]

Robert R Faulkner and Howard S Becker. 2009. "Do you know...?": The jazz repertoire in action. University of Chicago Press.

[13]

Rebecca Fiebrink and Perry R Cook. 2010. The Wekinator: a system for real-time, interactive machine learning in music. In Proceedings of The Eleventh International Society for Music Information Retrieval Conference (ISMIR 2010) (Utrecht).

[14]

Clifford Geertz. 2008. Thick description: Toward an interpretive theory of culture. In The Cultural Geography Reader. Routledge, 41-- 51.

[15]

Lucy Green. 2017. How popular musicians learn: A way ahead for music education. Routledge.

[16]

Chris Greenhalgh, Steve Benford, Adrian Hazzard, and Alan Chamberlain. 2017. Playing fast and loose with music recognition. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 4302--4313.

Digital Library

[17]

Susumu Harada, Jacob O Wobbrock, and James A Landay. 2007. Voicedraw: a hands-free voice-driven drawing application for people with motor impairments. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, 27--34.

Digital Library

[18]

Michaela Hoare, Steve Benford, Rachel Jones, and Natasa MilicFrayling. 2014. Coming in from the margins: amateur musicians in the online age. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1295--1304.

Digital Library

[19]

Kallionpaa, Maria and Greenhalgh, Chris and Hazzard, Adrian and Weigl, David M and Page, Kevin R and Benford, Steve (2017) Composing and Realising a Game-like Performance for Disklavier and Electronics. In Proceedings of 2017 New Interfaces for Musical Expression (NIME), 15--18 May 2017, Copenhagen, Denmark.

[20]

Shaun K Kane, Jacob O Wobbrock, and Ian E Smith. 2008. Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, 109--118.

Digital Library

[21]

Gerd Kortuem, Fahim Kawsar, Vasughi Sundramoorthy, and Daniel Fitton. 2010. Smart objects as building blocks for the internet of things. IEEE Internet Computing 14, 1: 44--51. https://doi.org/10/ckxwb3

Digital Library

[22]

Otso Lähdeoja. 2008. An Approach to Instrument Augmentation: the Electric Guitar. In Proceedings of the 2008 New Interfaces for Musical Expression Conference (NIME), 53--56.

[23]

Duncan MacConnell, Shawn Trail, George Tzanetakis, Peter Driessen, Wyatt Page, and NZ Wellington. 2013. Reconfigurable autonomous novel guitar effects (range). In Proceedings of the International Conference on Sound and Music Computing (SMC).

[24]

Sean McGrath, Alan Chamberlain, and Steve Benford. 2016. The Grime scene: social media, music, creation and consumption. In Proceedings of the Audio Mostly 2016, 245--250.

Digital Library

[25]

Andrew P. McPherson and Youngmoo Kim. 2010. Augmenting the Acoustic Piano with Electromagnetic String Actuation and Continuous Key Position Sensing. In Proceedings of the 2010 New Interfaces for Musical Expression Conference (NIME), 217--222.

[26]

Eduardo Reck Miranda and Marcelo M Wanderley. 2006. New digital musical instruments: control and interaction beyond the keyboard. Volume 21 of the Computer Music and Digital Audio Series. A-R Editions, Inc., Middleton, WI, 2006. ISBN 0--895790585-X.

[27]

Mark W Newman, Shahram Izadi, W Keith Edwards, Jana Z Sedivy, and Trevor F Smith. 2002. User interfaces when and where they are needed: an infrastructure for recombinant computing. In Proceedings of the 15th annual ACM symposium on User interface software and technology, 171--180.

Digital Library

[28]

Dan Newton and Mark T Marshall. 2011. Examining How Musicians Create Augmented Musical Instruments. In Proceedings of the 2011 New Interfaces for Musical Expression Conference (NIME), 155--160.

[29]

Alexander Ng, Stephen A Brewster, and John H Williamson. 2014. Investigating the effects of encumbrance on one-and two-handed interactions with mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1981--1990.

Digital Library

[30]

Jieun Oh, Jorge Herrera, Nicholas J. Bryan, Luke Dahl, and Ge Wang. 2010. Evolving the mobile phone orchestra. In Proceedings of the International Conference on New Interfaces for Musical Expression, 82--87.

[31]

Antti Oulasvirta and Joanna Bergstrom-Lehtovirta. 2011. Ease of juggling: studying the effects of manual multitasking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3103--3112.

Digital Library

[32]

Loïc Reboursière, Christian Frisson, Otso Lähdeoja, John A. Mills, Cécile Picard-Limpens, and Todor Todoroff. 2010. Multimodal Guitar: A Toolbox For Augmented Guitar Performances. In Proceedings of the 2010 New Interfaces for Musical Expression Conference (NIME), 415--418.

[33]

Yvonne Rogers. 2004. New theoretical approaches for human? computer interaction. Annual review of information science and technology 38, 1: 87--143. https://doi.org/10/cdt5mk

[34]

Lucy A. Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press.

Digital Library

[35]

Atau Tanaka. 2010. Mapping out instruments, affordances, and mobiles. In Proceedings of the 2010 New Interfaces for Musical Expression Conference (NIME), Sydney, Australia.

[36]

Luca Turchet. 2018. Smart Musical Instruments: vision, design principles, and future directions. IEEE Access: 1--1.

[37]

Luca Turchet, Carlo Fischione, and Mathieu Barthet. 2017. Towards the Internet of Musical Things. In Proceedings of the Sound and Music Computing Conference, 13--20.

[38]

Luca Turchet, Andrew McPherson, and Carlo Fischione. 2016. Smart instruments: Towards an ecosystem of interoperable devices connecting performers and audiences. In Proceedings of the Sound and Music Computing Conference, 498--505.

[39]

Zacharias Vamvakousis and Rafael Ramirez. 2016. The EyeHarp: A Gaze-Controlled Digital Musical Instrument. Frontiers in psychology 7: 906. https://doi.org/10/gd7hc9

[40]

Janice Waldron. 2013. User-generated content, YouTube and participatory culture on the Web: Music learning and teaching in two contrasting online communities. Music Education Research 15, 3: 257--274. https://doi.org/10/gdtg66

[41]

ULTIMATE GUITAR TABS. 1,100,000 songs catalog with free Chords, Guitar Tabs, Bass Tabs, Ukulele Chords and Guitar Pro Tabs! Retrieved September 21, 2018 from https://www.ultimateguitar.com/

[42]

SENSUS Smart Guitar by MIND Music Labs. MINDMusicLabs.com. Retrieved September 18, 2018 from https://www.mindmusiclabs.com/sensus/

[43]

Ultimate Guitar: Chords & Tabs. App Store. Retrieved September 20, 2018 from https://itunes.apple.com/gb/app/ultimate-guitar-chordstabs/id357828853?mt=8

Cited By

Wei BAlmeda STam EAbrahamson D(2024)Demonstration of Sympathetic Orchestra: An Interactive Conducting Education System for Responsive, Tacit Skill DevelopmentAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686783(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686783
Turchet LKrstulović S(2024)DSP as a Service: Foundations and DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34646965(6212-6226)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3464696
Vignati LNardini GCentenaro MCasari PLagén SBojovic BZambon STurchet L(2024)Is Music in the Air? Evaluating 4G and 5G Support for the Internet of Musical ThingsIEEE Access10.1109/ACCESS.2024.337464112(38081-38101)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3374641
Show More Cited By

Index Terms

Encumbered Interaction: a Study of Musicians Preparing to Perform
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing design and evaluation methods
      1. Ethnographic studies

Recommendations

Augmenting Guitars for Performance Preparation
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound

A substantial number of Digital Musical Instruments (DMIs) are built upon existing musical instruments by digitally and physically intervening in their design and functionality to augment their sonic and expressive capabilities. These are commonly known ...
The augmentalist: enabling musicians to develop augmented musical instruments
TEI '11: Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction

We present the Augmentalist: a system that allows a musician to augment their existing musical instrument using a variety of sensors. This system is focused on the musician and their musical aims, rather than the sensor technology being used. The overall ...
Workshop on embodied interaction: theory and practice in HCI
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

For over ten years researchers in human-computer interaction (HCI) have explored an embodied perspective that seeks to describe and explain the fundamental role played by the physical body in how we experience, interact with and understand computation ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

Consejo Nacional de Ciencia y Tecnologia
UK Engineering and Physical Sciences Research Council

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
1,143
Total Downloads

Downloads (Last 12 months)242
Downloads (Last 6 weeks)25

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wei BAlmeda STam EAbrahamson D(2024)Demonstration of Sympathetic Orchestra: An Interactive Conducting Education System for Responsive, Tacit Skill DevelopmentAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686783(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686783
Turchet LKrstulović S(2024)DSP as a Service: Foundations and DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34646965(6212-6226)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3464696
Vignati LNardini GCentenaro MCasari PLagén SBojovic BZambon STurchet L(2024)Is Music in the Air? Evaluating 4G and 5G Support for the Internet of Musical ThingsIEEE Access10.1109/ACCESS.2024.337464112(38081-38101)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3374641
Benford SMcGarry GHazzard AChamberlain AGibson RMartinez Avila J(2024)Augmenting musical instruments with digital identitiesJournal of New Music Research10.1080/09298215.2024.2423613(1-20)Online publication date: 14-Nov-2024
https://doi.org/10.1080/09298215.2024.2423613
Martinez Avila JHazzard AGreenhalgh CBenford SMcPherson A(2023)The Stretchy Strap: supporting encumbered interaction with guitarsJournal of New Music Research10.1080/09298215.2023.227483252:1(19-40)Online publication date: 10-Nov-2023
https://doi.org/10.1080/09298215.2023.2274832
Masu RBettega MCorreia NRomão T(2023)Investigating performance ecologies using screen scores: a case studyPersonal and Ubiquitous Computing10.1007/s00779-023-01719-y27:5(1887-1907)Online publication date: 20-May-2023
https://dl.acm.org/doi/10.1007/s00779-023-01719-y
Masu RCorreia NRomão T(2021)Technology-Mediated Musical Connections: The Ecology of a Screen-Score PerformanceProceedings of the 16th International Audio Mostly Conference10.1145/3478384.3478395(109-116)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1145/3478384.3478395
Höök KBenford STennent PTsaknaki VAlfaras MAvila JLi CMarshall JRoquet CSanches PStåhl AUmair MWindlin CZhou F(2021)Unpacking Non-Dualistic Design: The Soma Design CaseACM Transactions on Computer-Human Interaction10.1145/346244828:6(1-36)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3462448
Cai CCarney MZada NTerry MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Breakdowns and Breakthroughs: Observing Musicians’ Responses to the COVID-19 PandemicProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445192(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445192
Wang BYang MGrossman TKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio ProcessingProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445162(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445162
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents