More Web Proxy on the site http://driver.im/

Article

Wireless sensor interface and gesture-follower for music pedagogy

Authors:

Frederic Bevilacqua,

Fabrice Guédy,

Norbert Schnell,

Emmanuel Fléty,

Nicolas LeroyAuthors Info & Claims

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

Pages 124 - 129

https://doi.org/10.1145/1279740.1279762

Published: 06 June 2007 Publication History

Abstract

We present in this paper a complete gestural interface built to support music pedagogy. The development of this prototype concerned both hardware and software components: a small wireless sensor interface including accelerometers and gyroscopes, and an analysis system enabling gesture following and recognition. A first set of experiments was conducted with teenagers in a music theory class. The preliminary results were encouraging concerning the suitability of these developments in music education.

References

[1]

Aylward R. and Paradiso J., "Sensemble: Awireless, compact, multi-user sensor system for interactive dance" Proc. of the International Conference on New Interfaces for Musical Expression (NIME 06), Paris, France, 2006.

Digital Library

[2]

Bevilacqua, F., Muller, R., Schnell N. "MnM: a Max/MSP mapping toolbox", Proc. of the International Conference on New Interfaces for Musical Expression (NIME 05), Vancouver, Canada, 2005.

Digital Library

[3]

Bevilacqua F., Rasamimanana N., Fléty E., Lemouton S., Baschet F., "The augmented violin project: research, composition and performance report", Proc. s of the International Conference on New Interfaces for Musical Expression (NIME 06), Paris, France, 2006.

Digital Library

[4]

Benbasat, A. Y., and Paradiso, J. A., "An Inertial Measurement Framework for Gesture Recognition and Applications" In Ipke Wachsmuth, Timo Sowa (Eds.), "Gesture and Sign Language in Human-Computer Interaction" International Gesture Workshop, GW 2001, London, UK, 2001 Proceedings, Springer-Verlag, Berlin, 2002, pp. 9--20.

Digital Library

[5]

Borchers J., Hadjakos A., and Mühlhäuser M., "MICON: A Music Stand for Interactive Conducting", Proc. of the International Conference on New Interfaces for Musical Expression (NIME 06), pp 254--259, Paris, France, 2006.

Digital Library

[6]

Coduys, T., Henry, C. and Cont, A. "TOASTER and KROONDE: High-Resolution and High-Speed Real-time Sensor Interfaces" Proc. of the International Conference on New Interfaces for Musical Expression (NIME-04), Hamamatsu, Japan, 2004.

Digital Library

[7]

Ferguson F., "Learning Musical Instrument Skills Through Interactive Sonification" Proc. of the International Conference on New Interfaces for Musical Expression (NIME 06), pp 384--389, Paris, France, 2006.

Digital Library

[8]

Flety, E., "The WiSe Box: a Multi-performer Wireless. Sensor Interface using WiFi and OSC", Proc. of the International Conference on New Interfaces for Musical Expression (NIME05), Vancouver, Canada, 2005.

Digital Library

[9]

Guédy, F, "Le traitement du son en pédagogie musicale", L'Inouï, Vol. 2, Ircam - Editions Léo Scheer.

[10]

Puig V., Guédy F., Fingerhut M., Serrière F., Bresson J., Zeller O. "Musique Lab 2: A Three Level Approach for Music Education at School", Proc. of the International Computer Music Conference (ICMC 2005), Barcelona, Spain, 2005.

[11]

Iazzetta, F., "Meaning in Music Gesture", Trends in gestural Control of Music, Marc Battier & Marcelo M. Wanderley (Eds.) Paris-IRCAM - Centre Pompidou - CD-ROM, 2000.

[12]

Kolesnik P. and Wanderley M. M., "Recognition, Analysis and Performance with Expressive Conducting Gestures.", Proc. of the 2004 International Computer Music Conference (ICMC 2004), Miami, USA, 2004.

[13]

Lee E., Grüll I., Kiel H., and Borchers J., "3conga: A Framework for Adaptive Conducting Gesture Analysis" Proc. of the International Conference on New Interfaces for Musical Expression (NIME06), pp. 260--265, Paris, 2006.

Digital Library

[14]

Lee E., Karrer, T. and Borchers J., "Toward a Framework for Interactive Systems to Conduct Digital Audio and Video Streams" Computer Music Journal, 30(1):21--36, 2006.

Digital Library

[15]

Merrill, D. and Paradiso, J. A Personalization, "Expressivity, and Learnability of an Implicit Mapping Strategy for Physical Interfaces", Proc. of CHI 2005 Conference on Human Factors in Computing Systems, Extended Abstracts, ACM Press, Portland, OR, April 2--7, 2005, pp. 2152--2161.

[16]

Pritchard B., Fels S.: "GRASSP: Gesturally-Realized Audio, Speech and Song Performance". Proc. of the International Conference on New Interfaces for Musical Expression (NIME06), 272--271, Paris, France, 2006.

Digital Library

[17]

Schnell N., Schwarz, D. "Gabor, Multi-Representation Real-Time Analysis/Synthesis", COST-G6 Conference on Digital Audio Effects (DAFx), Madrid, Spain, 2005.

[18]

Schnell, N., Borghesi, R., Schwarz D., Bevilacqua, F. Müller, R. "FTM --- Complex data structures for Max", International Computer Music Conference (ICMC), Barcelona, Spain, 2005.

[19]

Rabiner L. R., Juang B., Tutorial on hidden Markov models and selected applications in speech recognition, Proc. of the IEEE, vol. 77, no. 2, pp. 257--285, 1989.

[20]

http://ecomote.net/

[21]

http://www.infusionsystems.com/

[22]

http://www.glui.de/

[23]

http://www.i-maestro.org/

[24]

http://www.maxstream.net/

[25]

http://www.opensoundcontrol.org/

[26]

http://www.sparkfun.com/

[27]

http://www.toysymphony.net/

[28]

http://www.xbow.com

Cited By

Kokkinidis KPatronas GGoudos SMaikantis TNikolaidis N(2023)Investigating the Relationship of User Acceptance to the Characteristics and Performance of an Educational Software in Byzantine MusicInformation10.3390/info1410056814:10(568)Online publication date: 15-Oct-2023
https://doi.org/10.3390/info14100568
Volioti CTsagaris ATrigkas DIliou TKatsantonis MMavridis I(2023)HapticSOUND: An Interactive Learning Experience with a Digital Musical InstrumentApplied Sciences10.3390/app1312714913:12(7149)Online publication date: 14-Jun-2023
https://doi.org/10.3390/app13127149
Peyre IRoby-Brami ASegalen MGiron ACaramiaux BMarchand-Pauvert VPradat-Diehl PBevilacqua F(2023)Effect of sonification types in upper-limb movement: a quantitative and qualitative study in hemiparetic and healthy participantsJournal of NeuroEngineering and Rehabilitation10.1186/s12984-023-01248-y20:1Online publication date: 5-Oct-2023
https://doi.org/10.1186/s12984-023-01248-y
Show More Cited By

Recommendations

A hand gesture interface device

This paper reports on the development of a hand to machine interface device that provides real-time gesture, position and orientation information. The key element is a glove and the device as a whole incorporates a collection of technologies. Analog ...
A hand gesture interface device
CHI '87: Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface

This paper reports on the development of a hand to machine interface device that provides real-time gesture, position and orientation information. The key element is a glove and the device as a whole incorporates a collection of technologies. Analog ...
A hand gesture interface device

This paper reports on the development of a hand to machine interface device that provides real-time gesture, position and orientation information. The key element is a glove and the device as a whole incorporates a collection of technologies. Analog ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

June 2007

484 pages

ISBN:9781450378376

DOI:10.1145/1279740

Conference Chairs:
Carol Parkinson
Harvestworks Digital Media Arts Center
,
Eric Singer
LEMUR: League of Electronic Musical Urban Robots

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

New York University Music Technology Program
Harvestworks
LEMUR: League of Electronic Musical Urban Robots

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
765
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kokkinidis KPatronas GGoudos SMaikantis TNikolaidis N(2023)Investigating the Relationship of User Acceptance to the Characteristics and Performance of an Educational Software in Byzantine MusicInformation10.3390/info1410056814:10(568)Online publication date: 15-Oct-2023
https://doi.org/10.3390/info14100568
Volioti CTsagaris ATrigkas DIliou TKatsantonis MMavridis I(2023)HapticSOUND: An Interactive Learning Experience with a Digital Musical InstrumentApplied Sciences10.3390/app1312714913:12(7149)Online publication date: 14-Jun-2023
https://doi.org/10.3390/app13127149
Peyre IRoby-Brami ASegalen MGiron ACaramiaux BMarchand-Pauvert VPradat-Diehl PBevilacqua F(2023)Effect of sonification types in upper-limb movement: a quantitative and qualitative study in hemiparetic and healthy participantsJournal of NeuroEngineering and Rehabilitation10.1186/s12984-023-01248-y20:1Online publication date: 5-Oct-2023
https://doi.org/10.1186/s12984-023-01248-y
Arterbury TPoor GArguelles Terron A(2023)Rhythmic Accuracy of 3D Spatial Interaction for Digital MusicProceedings of the 18th International Audio Mostly Conference10.1145/3616195.3616216(169-176)Online publication date: 30-Aug-2023
https://dl.acm.org/doi/10.1145/3616195.3616216
Escamilla AMelenchón JMonzo CMoran J(2023)User Clustering Visualization and Its Impact on Motion-Based Interaction DesignHuman-Computer Interaction10.1007/978-3-031-35596-7_4(47-63)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_4
Manitsaris S(2022)Vision par ordinateur pour la reconnaissance des gestes musicaux des doigtsRevue Francophone Informatique et Musique10.56698/rfim.1071:1Online publication date: 2022
https://doi.org/10.56698/rfim.107
Corintha ICabral G(2022)Improvisation Pedagogy: An Epistemological Perspective of the 4‘E’ Model within Digital Musical InstrumentsRevista Vórtex10.33871/23179937.2022.10.1.710:1(7)Online publication date: 30-Apr-2022
https://doi.org/10.33871/23179937.2022.10.1.7
Liu WMagalhaes MMackay WBeaudouin-Lafon MBevilacqua F(2022)Motor Variability in Complex Gesture Learning: Effects of Movement Sonification and Musical BackgroundACM Transactions on Applied Perception10.1145/348296719:1(1-21)Online publication date: 6-Jan-2022
https://dl.acm.org/doi/10.1145/3482967
Scurto HCaramiaux BBevilacqua F(2021)Prototyping Machine Learning Through Diffractive Art PracticeProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462163(2013-2025)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462163
Liu WDementyev ASchwarz DFlety EMackay WBeaudouin-Lafon MBevilacqua FKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)SonicHoop: Using Interactive Sonification to Support Aerial Hoop PracticesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445539(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445539
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents