More Web Proxy on the site http://driver.im/

article

Musical performance analysis in terms of emotions it evokes

Author:

Jacek GrekowAuthors Info & Claims

Journal of Intelligent Information Systems, Volume 51, Issue 2

Pages 415 - 437

https://doi.org/10.1007/s10844-018-0510-y

Published: 01 October 2018 Publication History

Abstract

Finding pieces with a similar emotional distribution throughout the same composition was the aim of this work. A comparative analysis of musical performances by using emotion tracking was proposed. A dimensional approach of dynamic music emotion recognition was used in the analysis. Music data annotation and regressor training were done. Values of arousal and valence, predicted by regressors, were used to compare performances. The obtained results confirm the validity of the assumption that tracking and analyzing the values of arousal and valence over time in different performances of the same composition can be used to indicate their similarities. Detailed results of analyzing different performances of Prelude No.1 by Frédéric Chopin were presented. They enabled to find the most similar performances to the performance by Arthur Rubinstein, for example. The author found which performances of the same composition were closer to each other and which were quite distant in terms of the shaping of arousal and valence over time. The presented method gives access to knowledge on the shaping of emotions by a performer, which had previously been available only to music professionals.

References

[1]

Aljanaki, A., Yang, Y.H., Soleymani, M. (2016). Emotion in music task: lessons learned. In Working Notes Proceedings of the MediaEval 2016 Workshop. Netherlands: Hilversum.

[2]

Bogdanov, D., Wack, N., Gómez, E., Gulati, S., Herrera, P., Mayor, O., Roma, G., Salamon, J., Zapata, J., Serra, X. (2013). ESSENTIA: an audio analysis library for music information retrieval. In Proceedings of the 14th International Society for Music Information Retrieval Conference (pp. 493-498), Curitiba.

[3]

Bresin, R., & Friberg, A. (2000). Emotional coloring of computer-controlled music performances. Computer Music Journal, 24(4), 44-63.

Digital Library

[4]

Cannam, C., Landone, C., Sandler, M. (2010). Sonic visualiser: an open source application for viewing, analysing, and annotating music audio files. In Proceedings of the ACM Multimedia 2010 International Conference (pp. 1467-1468), Firenze.

Digital Library

[5]

Chen, P.Y., & Popovich, P.M. (2002). Correlation: parametric and nonparametric measures. Sage: Thousand Oaks Calif.

[6]

Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.

[7]

Dixon, S., & Widmer, G. (2005). MATCH: a music alignment tool chest. In ISMIR, 2005, 6th International Conference on Music Information Retrieval (pp. 492-497). London: Proceedings.

[8]

Goebl, W., Pampalk, E., Widmer, G. (2004). Exploring expressive performance trajectories: six famous pianists play six chopin pieces. In Proceedings of the 8th International Conference on Music Perception and Cognition (ICMPC'8) (pp. 505-509), Evanston.

[9]

Gómez, E., & Bonada, J. (2005). Tonality visualization of polyphonic audio. In Proceedings of the International Computer Music Conference. Barcelona.

[10]

Grekow, J. (2012). Mood tracking of musical compositions. In Chen, L., Felfernig, A., Liu, J., Rás, Z.W. (Eds.) Foundations of Intelligent Systems: 20th International Symposium, ISMIS 2012, Macau, China (pp. 228-233). Berlin: Proceedings, Springer Berlin Heidelberg.

Digital Library

[11]

Grekow, J. (2016). Computer Information Systems and Industrial Management: 15th IFIP TC8 International Conference, CISIM 2016, Vilnius, Lithuania. In Saeed, K., & Homenda, W. (Eds.) (pp. 697-706). Cham: Proceedings, Springer International Publishing.

[12]

Grekow, J. (2017). Audio features dedicated to the detection of arousal and valence in music recordings. In 2017 IEEE International Conference on INnovations in Intelligent SysTems and Applications (INISTA) (pp. 40-44), IEEE.

[13]

Korhonen, M.D., Clausi, D.A., Jernigan, M.E. (2005). Modeling emotional content of music using system identification. Transactions on Systems Man and Cybernetics Part B, 36(3), 588-599.

Digital Library

[14]

Liem, C.C.S., & Hanjalic, A. (2015). Comparative analysis of orchestral performance recordings: an imagebased approach. In Proceedings of the 16th International Society for Music Information Retrieval Conference, ISMIR 2015 (pp. 302-308), Malaga, Spain.

[15]

Lu, L., Liu, D., Zhang, H.J. (2006). Automatic mood detection and tracking of music audio signals. Trans Audio. Speech and Language Proceedings, 14(1), 5-18.

Digital Library

[16]

M?uller, M., & Jiang, N. (2012). A scape plot representation for visualizing repetitive structures of music recordings. In Proceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012 (pp. 97-102), Mosteiro S.Bento Da Vit?oria, Porto, Portugal.

[17]

Rabiner, L., & Juang, B.H. (1993). Fundamentals of Speech Recognition. Upper Saddle River: Prentice-Hall, Inc.

Digital Library

[18]

Russell, J.A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161-1178.

[19]

Sapp, C.S. (2001). Harmonic visualizations of tonal music. In Proceedings of the 2001 International Computer Music Conference, ICMC 2001, Havana, Cuba.

[20]

Sapp, C.S. (2007). Comparative analysis of multiple musical performances. In Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007 (pp. 497-500), Vienna, Austria.

[21]

Sapp, C.S. (2008). Hybrid numeric/rank similarity metrics for musical performance analysis. In ISMIR 2008, 9th International Conference on Music Information Retrieval (pp. 501-506). Philadelphia: Drexel University.

[22]

Schmidt, E.M., Turnbull, D., Kim, Y.E. (2010). Feature selection for content-based, time-varying musical emotion regression. In Proceedings of the International Conference on Multimedia Information Retrieval, MIR'10 (pp. 267-274). New York: ACM.

Digital Library

[23]

Segnini, R., & Sapp, C. (2006). Scoregram: Displaying Gross Timbre Information from a Score (pp. 54-59). Berlin: Springer Berlin Heidelberg.

Digital Library

[24]

Widmer, G., & Goebl, W. (2004). Computational models of expressive music performance: the state of the art. Journal of New Music Research, 33(3), 203-216.

[25]

Witten, I.H., & Frank, E. (2005). Data Mining: practical machine learning tools and techniques. San Francisco: Morgan Kaufmann.

Digital Library

[26]

Yang, Y.H., Lin, Y.C., Su, Y.F., Chen, H.H. (2008). A regression approach to music emotion recognition. Trans Audio. Speech and Language Proceedings, 16(2), 448-457.

Digital Library

Cited By

Grekow J(2021)Music emotion recognition using recurrent neural networks and pretrained modelsJournal of Intelligent Information Systems10.1007/s10844-021-00658-557:3(531-546)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1007/s10844-021-00658-5
Dimitrova-Grekow TKonopko P(2019)New Parameters for Improving Emotion Recognition in Human Voice^*2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)10.1109/SMC.2019.8914444(4205-4210)Online publication date: 6-Oct-2019
https://dl.acm.org/doi/10.1109/SMC.2019.8914444

Recommendations

Relations between selected musical parameters and expressed emotions: extending the potential of computer entertainment
ACE '05: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology

A fundamental aspect of music is its ability to express emotions. To develop and extend the potential of music in computer entertainment, a deeper understanding of music's emotional aspects is essential. An experiment was designed to explore the ...
Music Emotion Maps in Arousal-Valence Space
Computer Information Systems and Industrial Management
Abstract
In this article we present the approach in which the detection of emotion is modeled by the pertinent regression problem. Conducting experiments required building a database, annotation of samples by music experts, construction of regressors, ...
Synchronization and fluctuation of rhythm in musical cooperative performance
HCII'11: Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I

A live musical performance gives us better impression than recorded music heard from a portable music player. From player's point of view, live performance also gives better impression than playing music with metronome or recorded music. Thus, the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Intelligent Information Systems

Journal of Intelligent Information Systems Volume 51, Issue 2

October 2018

245 pages

ISSN:0925-9902

Issue’s Table of Contents

Copyright © Copyright © 2018 Springer Science+Business Media, LLC, part of Springer Nature.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 October 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Grekow J(2021)Music emotion recognition using recurrent neural networks and pretrained modelsJournal of Intelligent Information Systems10.1007/s10844-021-00658-557:3(531-546)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1007/s10844-021-00658-5
Dimitrova-Grekow TKonopko P(2019)New Parameters for Improving Emotion Recognition in Human Voice^*2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)10.1109/SMC.2019.8914444(4205-4210)Online publication date: 6-Oct-2019
https://dl.acm.org/doi/10.1109/SMC.2019.8914444

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents