Towards an interactive multimedia experience for club music and dance
Pages 95 - 104
Abstract
In this paper, we describe completed and ongoing work towards an interactive multimedia system that will appeal to today's youth culture identified as most likely to adopt such novel mobile applications that combines music, dance and technology. We describe our work in the application of three types of successful movement recognition applied in the field of Tai Chi with the objective being to identify gestural primitives of club dance associated with electronic dance music. In this approach, dance movements are first recognized and classified and then mapped, using multiple levels of complexity, to higher level algorithms that can modify multimedia content in real time. The paper describes the mechanisms supporting an attractive alternative to the now standard Video Disc Jockey (VJ) in which members of the dance public are empowered to create multimedia content in real time as opposed to the VJ.
References
[1]
http://en.wikipedia.org/wiki/Wii_MotionPlus/.
[2]
http://en.wikipedia.org/wiki/Project_Natal/.
[3]
K. Kunze, M. Barry, E. Heinz, P. Lukowicz, D. Majoe, J. Gutknecht, "Towards Recognizing Tai Chi - An Initial Experiment UsingWearable Sensors", 3rd International Forum on Applied Wearable Computing, Mobile Research Center, Universität Bremen, Bremen, Germany, 2006.
[4]
D. Majoe, I. Kulka, and J. Gutknecht, "Qi energy flow visualisation using wearable computing," Pervasive Computing and Applications, 2007. ICPCA 2007. 2nd International Conference on, pp. 285--290, 26--27 July 2007.
[5]
D. Majoe, M. Estermann, N. Ranieri, J. Gutknecht, "Ergonomic Low Cost Motion Capture for every day health exercise" Pervasive Computing and Applications, 2008. ICPCA 2008. Third International Conference Volume: 2, On page(s): 627-6326-8 Oct. 2008.
[6]
Jürg Gutknecht, Irena Kulka, Paul Lukowicz, Sven Stauber, Tom Stricker, "Advances in Expressive Animation in the Interactive Performance of a Butoh Dance ", Communications in Computer and Information Science, Transdisciplinary Digital Art. Sound, Vision and the New Screen Volume Volume 7, SSN 1865--0929, Springer Berlin Heidelberg, 2008.
[7]
Antonio Camurri, Ingrid Lagerlof, Gualtiero Volpe, "Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques.", International Journal of Human-Computer Studies In Applications of Affective Computing in Human-Computer Interaction, Vol. 59, No. 1--2. (July 2003), pp. 213--225.
[8]
Antonio Camurri, Barbara Mazzarino, Gualtiero Volpe, "A tool for analysis of expressive gestures: The EyesWeb Expressive Gesture Processing Library.", InfoMus Lab (Laboratorio di Informatica Musicale) DIST -- University of Genova, http://infomus.dist.unige.it
[9]
Wikipedia, "Forward kinematic animation", http://en.wikipedia.org/wiki/Forward_kinematic_animation
[10]
Kanav Kahol, Priyamvada Tripathi, Sethuraman Panchanathan, " Computational Analysis of Mannerism Gestures." Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Pages: 946--949, 2004.
[11]
L. R. Rabiner. "A tutorial on HMM and selected applications in speech recognition". In Proc. IEEE, Vol. 77, No. 2, pp. 257--286, Feb. 1989.
[12]
M. Brand, N. Oliver, A. Pentland, "Coupled hidden Markov models for complex action recognition." Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997.
[13]
HongLi Zhu, Peng Ying Du, Jian Xiang. "3D Motion Recognition based on Ensemble Learning", Proceedings of the Eighth International Workshop on Image Analysis for Multimedia Interactive Services, 2007.
[14]
AF Bobick, AD. Wilson, "A state based technique for the summarization and recognition of gesture.", Proceedings 5th international conference on Computer Vision 1995.
[15]
A. Bobick and J. Davis. The recognition of human movement using temporal templates. IEEE Trans. Patt. Analy. and Mach. Intell., 23(3), 2001.
[16]
Freeman, W. J.," Societies of Brains. A Study in the Neuroscience of Love and Hate" Hillsdale, NJ: Lawrence Erlbaum Associates 1995
[17]
Randolph Blake, Maggie Shiffrar, "Perception of Human Motion", Annual Review of Psychology, Vol. 58: 47--73 (January 2007)
[18]
Silla, C. N.; Kaestner, C. A. A.; Koerich, A. L. "Automatic music genre classification using ensemble of classifiers", IEEE International Conference on Systems, Man and Cybernetics, 7--10 Oct. 2007 Page(s):1687--1692
[19]
Youngblood, G "Expanded Cinema", P. Dutton & Co., Inc., New York 1970
[20]
M. Makela, "Live Cinema: Language and Elements", MA in New Media, Media Lab, Helsinki University of Art and Design, 2006
[21]
J. C. Schacher, "Live Audiovisual Performance as a Cinematic Practice", The Cinematic Experience, Sonic Acts XII, February 2008 Amsterdam, Sonic Acts Press
[22]
J. C. Schacher, "Action and Perception in Interactive Sound Installations: An Ecological Approach", Proceedings, New Interfaces for Musical Expression, NIME 2009 Conference, Pittsburgh, PA
[23]
A. Camurri, "Multimodal Interfaces For Expressive Sound Control", Proceedings of the 7th International Conference on Digital Audio Effects (DAFX-04), Naples, Italy, 2004
[24]
Camurri, A, Mazzarino, B, Volpe G, "Expressive Gestural Control Of Sound And Visual Output In Multimodal Interactive Systems" Proceedings of the Sound and Music Computing Conference SMC 2004, Paris, France
[25]
J. C. Schacher, "Gesture Control of Sounds in 3D Space", Proceedings, New Interfaces for Musical Expression, NIME 2007 Conference, New York, NY
Recommendations
enabling the VJ as performer with rhythmic wearable interfaces
MM '11: Proceedings of the 19th ACM international conference on MultimediaThis paper proposes an experimental wearable controller for live video performances called the VJacket. The VJacket can be worn by the performer or visual artist (VJ) to control video effects and transitions, trigger clips or scratch frames with the ...
Music Control in an Interactive Conducting System Using Kinect
Music conducting is the art of directing musical ensembles with hand gestures to personalize and diversify a piece of music. Although the ability to successfully perform a musical piece demands intense training and coordination for the conductor and the ...
Interactive music 3.0: empowering people to participate musically inside nightclubs
CMMR'11: Proceedings of the 8th international conference on Speech, Sound and Music Processing: embracing research in IndiaNightclubs are powerhouses in western culture for social listening and dancing to music. Here, mostly digital, pre-composed tunes are selected, mixed and played by a person called Disc Jockey. In another digital arena, the internet, a revolution is ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2009
663 pages
ISBN:9781605586595
DOI:10.1145/1821748
- General Chair:
- Gabriele Kotsis,
- Program Chairs:
- David Taniar,
- Eric Pardede
Copyright © 2009 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- Johannes Kepler University
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 December 2009
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MoMM '09
Sponsor:
MoMM '09: 7th International Conference on Mobile Computing and Multimedia
December 14 - 16, 2009
Kuala Lumpur, Malaysia
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 257Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in