[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3430524.3442456acmotherconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
Work in Progress

Kinesthetic Empathy in Remote Interactive Performance: Research into Platforms and Strategies for Performing Online

Published: 14 February 2021 Publication History

Abstract

In interactive performance, kinesthetic empathy refers to the ability of performers to read, decode, and react to one another’s physical input. To develop kinesthetic empathy, performers rely on sonic, visual, and other sensory cues. Remote and interactive performance oftentimes limits these cues due to deficiencies of the virtual environment. In this case, performers must develop connections between alternate sensory modes to achieve kinesthetic empathy. This paper explores alternative systems for remote performance and investigates the ways in which human players creatively exploit these platforms as well as defining pre-requisite sensory connections needed to achieve kinesthetic empathy between remote participants. We present three examples of technologies and performance techniques used to achieve this connection. We then present a new system modified for remote performance and propose a strategy for demonstrating it to peers in order to discern its effectiveness in facilitating kinesthetic empathy between multiple players as well as players and audience. We use current research data in cognitive psychology as a baseline for our own inquiry and hope our experiences will inspire future research in that field.

References

[1]
Curtis Bahn, Tomie Hahn, and Dan Trueman. 2001. Physicality and Feedback: A Focus on the Body in the Performance of Electronic Music. Proceedings of the International Computer Music Conference 2001, 2(2001), 44–51. https://doi.org/10.1016/S0140-6736(01)05627-6
[2]
C Chafe and M Gurevich. 2004. Network Time Delay and Ensemble Accuracy: Effects of Latency, Asymmetry. In Proc. of the 117th Convention of the Audio Eng. Soc.Audio Engineering Society.
[3]
Elaine Chew, Roger Zimmermann, A A Sawchuk, Christos Kyriakakis, Christos Papadopoulos, A R J François, G Kim, A Rizzo, and Anja Volk. 2004. Musical Interaction at a Distance: Distributed Immersive Performance. In Proceedings of the MusicNetwork Fourth Open Workshop on Integration of Music in Multimedia Applications. 1–10. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.138.439
[4]
Edward T. Cone. 1968. Musical form and musical performance(first edit ed.). W. W. Norton. 103 pages. https://www.worldcat.org/title/musical-form-and-musical-performance/oclc/436472
[5]
Alexander P. Demos and Roger Chaffin. 2018. How music moves US: Entraining to musicians’ movements. Music Perception 35, 4 (apr 2018), 405–424. https://doi.org/10.1525/MP.2018.35.4.405
[6]
Alexander P. Demos, Hamed Layeghi, Marcelo M. Wanderley, and Caroline Palmer. 2019. Staying Together: A Bidirectional Delay–Coupled Approach to Joint Action. Cognitive Science 43, 8 (aug 2019), e12766. https://doi.org/10.1111/cogs.12766
[7]
William Duckworth. 2013. Virtual Music: How the Web Got Wired for Sound. Routledge, London. https://doi.org/10.4324/9780203626160
[8]
Elizabeth Fife and Francis Pereira. 2002. Socio-Economic and Cultural Factors Affecting Adoption of Broadband Access: A Cross-Country Analysis. Journal of The Communications Network 1, 2 (2002), 62–69.
[9]
Maiken Hillerup Fogtmann, Jonas Fritsch, and Karen Johanne Kortbek. 2008. Kinesthetic Interaction - Revealing the bodily potential in interaction design. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat, [OZCHI’08]. ACM Press, New York, New York, USA, 89–96. https://doi.org/10.1145/1517744.1517770
[10]
Henry Head and Gordon Holmes. 1911. Sensory disturbances from cerebral lesions. Brain 34, 2-3 (1911), 102–254.
[11]
Claudia Hendrix and Woodrow Barfield. 1996. The sense of presence within auditory virtual environments. Presence: Teleoperators and Virtual Environments 5, 3 (mar 1996), 290–301. https://doi.org/10.1162/pres.1996.5.3.290
[12]
Erik Hollnagel. 2002. Cognition as control: A pragmatic approach to the modelling of joint cognitive systems. Control 9, October 2002 (2002), 1–23.
[13]
Ryan Ingebritsen, Christopher Knowlton, Hugh Sato, and Erica Mott. 2020. Social movements: A case study in dramaturgically-driven sound design for contemporary dance performance to mediate human-human interaction. In TEI 2020 - Proceedings of the 14th International Conference on Tangible, Embedded, and Embodied Interaction. Association for Computing Machinery, Inc, New York, NY, USA, 227–237. https://doi.org/10.1145/3374920.3374955
[14]
Jari Kleimola. 2006. Latency Issues in Distributed Musical Performance. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.97.3189https://pdfs.semanticscholar.org/792c/743e72c9b00650e98df5f90618dee457ffbd.pdf
[15]
Maori Kobayashi, Kanako Ueno, and Shiro Ise. 2015. The effects of spatialized sounds on the sense of presence in auditory virtual environments: A psychological and physiological study. Presence: Teleoperators and Virtual Environments 24, 2 (may 2015), 163–174. https://doi.org/10.1162/PRES_a_00226
[16]
Pontus Larsson, Daniel Västfjäll, and Mendel Kleiner. 2008. Effects of auditory information consistency and room acoustic cues on presence in virtual environments. Acoustical Science and Technology 29, 2 (mar 2008), 191–194. https://doi.org/10.1250/ast.29.191
[17]
John Martin. 1936. America dancing: The background and personalities of the modern dance. Dance Horizons, New York. 117 pages.
[18]
John C. Middlebrooks and David M. Green. 1991. Sound localization by human listeners. Annual Review of Psychology 42, 1 (1991), 135–159. https://doi.org/10.1146/annurev.ps.42.020191.001031
[19]
Matthew Reason and Dee Reynolds. 2010. Kinesthesia, empathy, and related pleasures: An inquiry into audience experiences of watching dance. Dance Research Journal 42, 2 (2010), 49–75. https://doi.org/10.1017/S0149767700001030
[20]
Alain Renaud, A Carot, and Pedro Rebelo. 2007. Networked Music Performance: State of the Art. In Proceedings of the AES 30th International Conference. Audio Engineering Society, 1–7.
[21]
Cristina Rottondi, Chris Chafe, Claudio Allocchio, and Augusto Sarti. 2016. An overview on networked music performance technologies. IEEE Access 4(2016), 8823–8843. https://doi.org/10.1109/ACCESS.2016.2628440
[22]
Mel Slater. 2017. Implicit Learning Through Embodiment in Immersive Virtual Reality. In Virtual, Augmented, and Mixed Realities in Education, Dejian Liu, Chris Dede, Ronghuai Huang, and John Richards (Eds.). Springer Singapore, Chapter 2, 19–33. https://doi.org/10.1007/978-981-10-5490-7
[23]
Wieslaw Woszczyk, Jeremy Cooperstock, John Roston, and William Martens. 2005. Shake, rattle, and roll: Getting immersed in multisensory, interactive music via broadband networks. AES: Journal of the Audio Engineering Society 53, 4 (apr 2005), 336–343.
[24]
Nick Yee and Jeremy Bailenson. 2007. The proteus effect: The effect of transformed self-representation on behavior. Human Communication Research 33, 3 (jul 2007), 271–290. https://doi.org/10.1111/j.1468-2958.2007.00299.x

Cited By

View all
  • (2022)And She Will Sound The Alarm: Performance and Demo of the Body Sample PlayerProceedings of the 8th International Conference on Movement and Computing10.1145/3537972.3538019(1-4)Online publication date: 22-Jun-2022
  • (2021)Current Use, Non-Use, and Future Use of Ballet Learning TechnologiesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462107(2052-2067)Online publication date: 28-Jun-2021

Index Terms

  1. Kinesthetic Empathy in Remote Interactive Performance: Research into Platforms and Strategies for Performing Online
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction
      February 2021
      908 pages
      ISBN:9781450382137
      DOI:10.1145/3430524
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 14 February 2021

      Check for updates

      Author Tags

      1. digital musical instruments
      2. kinesthetic empathy
      3. networked music performance
      4. remote performance

      Qualifiers

      • Work in progress
      • Research
      • Refereed limited

      Conference

      TEI '21

      Acceptance Rates

      TEI '21 Paper Acceptance Rate 40 of 136 submissions, 29%;
      Overall Acceptance Rate 393 of 1,367 submissions, 29%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)14
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 13 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2022)And She Will Sound The Alarm: Performance and Demo of the Body Sample PlayerProceedings of the 8th International Conference on Movement and Computing10.1145/3537972.3538019(1-4)Online publication date: 22-Jun-2022
      • (2021)Current Use, Non-Use, and Future Use of Ballet Learning TechnologiesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462107(2052-2067)Online publication date: 28-Jun-2021

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media