Article

Expressive control of music and visual media by full-body movement

Authors:

Ginevra Castellano,

Roberto Bresin,

Antonio Camurri,

Gualtiero VolpeAuthors Info & Claims

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

Pages 390 - 391

https://doi.org/10.1145/1279740.1279829

Published: 06 June 2007 Publication History

Get Access

Abstract

In this paper we describe a system which allows users to use their full-body for controlling in real-time the generation of an expressive audio-visual feedback. The system extracts expressive motion features from the user's full-body movements and gestures. The values of these motion features are mapped both onto acoustic parameters for the real-time expressive rendering of a piece of music, and onto real-time generated visual feedback projected on a screen in front of the user.

References

[1]

Bresin, R.: What is the color of that music performance?, In proceedings of the International Computer Music Conference-ICMC 2005, 367--370, 2005.

Google Scholar

[2]

Camurri, A.: Interactive Dance/Music Systems, Proc. Intl. Computer Music Conference ICMC-95, pp.245--252, The Banff Centre for the arts, Sept.3-7, 1995, Canada, ICMA-Intl. Comp. Mus. Association.

Google Scholar

[3]

Camurri, A., Lagerlöf, I, Volpe, G.: Recognizing Emotion from Dance Movement: Comparison of Spectator Recognition and Automated Techniques, International Journal of Human-Computer Studies, 59(1--2), pp. 213--225, Elsevier Science, July 2003.

Digital Library

Google Scholar

[4]

Camurri A., Coletta P., Massari A., Mazzarino B., Peri M., Ricchetti M., Ricci A., Volpe G.: Toward real-time multimodal processing: EyesWeb 4.0, in Proc. AISB 2004 Convention: Motion, Emotion and Cognition, Leeds, UK, March 2004.

Google Scholar

[5]

Friberg, A.: pDM: an expressive sequencer with real-time control of the KTH music performance rules. Computer Music Journal, 30(1), 37--48, 2006.

Digital Library

Google Scholar

[6]

Machover, T. and Chung J.: Hyperinstruments: Musically intelligent and interactive performance and creativity systems. Proc. ICMC'89, 186--190, 1989.

Google Scholar

[7]

Wallbott, H. G.: Bodily expression of emotion. European Journal of Social Psychology, Eur. J. Soc. Psychol. 28, 879--896, 1998.

Crossref

Google Scholar

Cited By

View all

Arterbury TPoor GArguelles Terron A(2023)Rhythmic Accuracy of 3D Spatial Interaction for Digital MusicProceedings of the 18th International Audio Mostly Conference10.1145/3616195.3616216(169-176)Online publication date: 30-Aug-2023
https://dl.acm.org/doi/10.1145/3616195.3616216
Poggi ID’Errico FAnsani A(2020)The conductor’s intensity gesturesPsychology of Music10.1177/030573562096317949:6(1478-1497)Online publication date: 21-Oct-2020
https://doi.org/10.1177/0305735620963179
Masu RCorreia NJurgens SFeitsch JRomão TGroß-Vogt KHöldrich R(2020)Designing interactive sonic artefacts for dance performanceProceedings of the 15th International Audio Mostly Conference10.1145/3411109.3412297(122-129)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3411109.3412297
Show More Cited By

Expressive control of music and visual media by full-body movement
1. Applied computing
  1. Arts and humanities

Recommendations

User-Centered Control of Audio and Visual Expressive Feedback by Full-Body Movements
ACII '07: Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction

In this paper we describe a system allowing users to express themselves through their full-body movement and gesture and to control in real-time the generation of an audio-visual feedback. The systems analyses in real-time the user's full-body movement ...
Effect of Body Movement on Music Expressivity in Jazz Performances
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends

In this study, we tried to examine empirically how body motion contributes to music expressivity, both in terms of intensity and manners, during impromptu jazz performances. Psychological rating experiments showed that music expressivity in jazz ...
Managing gesture and timbre for analysis and instrument control in an interactive environment
NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression

This paper describes recent enhancements in an interactive system designed to improvise with saxophonist John Butcher [1]. In addition to musical parameters such as pitch and loudness, our system is able to analyze timbral characteristics of the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

June 2007

484 pages

ISBN:9781450378376

DOI:10.1145/1279740

Conference Chairs:
Carol Parkinson
Harvestworks Digital Media Arts Center
,
Eric Singer
LEMUR: League of Electronic Musical Urban Robots

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
441
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Arterbury TPoor GArguelles Terron A(2023)Rhythmic Accuracy of 3D Spatial Interaction for Digital MusicProceedings of the 18th International Audio Mostly Conference10.1145/3616195.3616216(169-176)Online publication date: 30-Aug-2023
https://dl.acm.org/doi/10.1145/3616195.3616216
Poggi ID’Errico FAnsani A(2020)The conductor’s intensity gesturesPsychology of Music10.1177/030573562096317949:6(1478-1497)Online publication date: 21-Oct-2020
https://doi.org/10.1177/0305735620963179
Masu RCorreia NJurgens SFeitsch JRomão TGroß-Vogt KHöldrich R(2020)Designing interactive sonic artefacts for dance performanceProceedings of the 15th International Audio Mostly Conference10.1145/3411109.3412297(122-129)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3411109.3412297
Shin KLee IBaek J(2019)An Improved Real-Time Contrasts Control Chart Using Novelty Detection and Variable ImportanceApplied Sciences10.3390/app90101739:1(173)Online publication date: 5-Jan-2019
https://doi.org/10.3390/app9010173
Çarçani KHansen VMaartmann-Moe H(2018)Exploring Technology Use in Dance PerformancesHuman-Computer Interaction. Interaction in Context10.1007/978-3-319-91244-8_22(268-280)Online publication date: 1-Jun-2018
https://doi.org/10.1007/978-3-319-91244-8_22
Pietroni E(2017)From Remote to Embodied Sensing: New Perspectives for Virtual Museums and Archaeological Landscape CommunicationDigital Methods and Remote Sensing in Archaeology10.1007/978-3-319-40658-9_19(437-474)Online publication date: 11-Feb-2017
https://doi.org/10.1007/978-3-319-40658-9_19
Rosa-Pujazón ABarbancho ITardón LBarbancho A(2016)Fast-gesture recognition and classification using KinectMultimedia Tools and Applications10.1007/s11042-015-2729-875:14(8137-8164)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1007/s11042-015-2729-8
Rosa-Pujazón ABarbancho ITardón LBarbancho A(2015)A Virtual Reality Drumkit Simulator System with a Kinect DeviceInternational Journal of Creative Interfaces and Computer Graphics10.4018/IJCICG.20150101056:1(72-86)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.4018/IJCICG.2015010105
Herrero GBarbancho ITardón LRosa-Pujazón ABarbancho A(2015)Drumkit simulator from everyday desktop objectsMultimedia Tools and Applications10.1007/s11042-014-2159-z74:23(10195-10213)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1007/s11042-014-2159-z
Ibanez J(2013)Emotional Sea: Showing Valence and Arousal Through the Sharpness and Movement of Digital Cartoonish Sea WavesIEEE Transactions on Systems, Man, and Cybernetics: Systems10.1109/TSMCA.2012.222054243:4(901-910)Online publication date: Jul-2013
https://doi.org/10.1109/TSMCA.2012.2220542
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

User-Centered Control of Audio and Visual Expressive Feedback by Full-Body Movements

Effect of Body Movement on Music Expressivity in Jazz Performances

Managing gesture and timbre for analysis and instrument control in an interactive environment