[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3386164.3389096acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiscsicConference Proceedingsconference-collections
research-article

Singing Evaluation based on Deep Metric Learning

Published: 06 June 2020 Publication History

Abstract

This paper aims to evaluate singing performance based on deep metric learning. As the vocal sound will be the input, we will first need to separate that from a soundtrack. After the separation, the vocal audio will be represented by Mel-spectrogram as an input in our proposed model. The process to build up our model splits into pre-training and training steps. Meta learning is adopted for pre-training while deep metric learning is adopted for training. The output of the model is a Euclidean distance reflecting the singers' performance, which is determined by comparing their sounds to the originals. Experimental results show a stable and reliable singing evaluation.

References

[1]
Goto, Masataka. "Singing information processing." 2014 12th International Conference on Signal Processing (ICSP). IEEE, 2014.
[2]
He K, et al. "Deep residual learning for image recognition." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
[3]
Hoffer, Elad, and Nir Ailon. "Deep metric learning using triplet network." International Workshop on Similarity-Based Pattern Recognition. Springer, Cham, 2015.
[4]
Kingma, D. P., and Jimmy Ba. "Adam: A method for stochastic optimization." arXiv preprint arXiv:1412.6980 (2014).
[5]
Lin, Chang-Hung, et al. "Automatic singing evaluating system based on acoustic features and rhythm." 2014 International Conference on Orange Technologies. IEEE, 2014.
[6]
Maka, Tomasz. "Attributes of audio feature contours for automatic singing evaluation." 2013 36th International Conference on Telecommunications and Signal Processing (TSP). IEEE, 2013.
[7]
Rafii, Zafar, and Bryan Pardo. "Repeating pattern extraction technique (REPET): A simple method for music/voice separation." IEEE transactions on audio, speech, and language processing 21.1 (2013): 73--84.
[8]
Sung, Flood, et al. "Learning to compare: Relation network for few-shot learning." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018.
[9]
Schroff, Florian, Dmitry Kalenichenko, and James Philbin. "Facenet: A unified embedding for face recognition and clustering." Proceedings of the IEEE conference on computer vision and pattern recognition. 2015.
[10]
Tsai, Wei-Ho, and Hsin-Chieh Lee. "Automatic evaluation of karaoke singing based on pitch, volume, and rhythm features." IEEE Transactions on Audio, Speech, and Language Processing 20.4 (2012): 1233--1243.
[11]
Vijayan, Karthika, Xiaoxue Gao, and Haizhou Li. "Analysis of speech and singing signals for temporal alignment." 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). IEEE, 2018.
[12]
Wang, Chung-Che, and Jyh-Shing Roger Jang. "Improving query-by-singing/humming by combining melody and lyric information." IEEE/ACM Transactions on Audio, Speech, and Language Processing 23.4 (2015): 798--806.
[13]
Yu, Yang, et al. "Performance scoring of singing voice." 2015 International Conference on Asian Language Processing (IALP). IEEE, 2015.
[14]
Zhang, Ning, et al. "Automatic Singing Evaluation without Reference Melody Using Bi-dense Neural Network." ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2019.
[15]
Zheng, Jiewen, Qingli Ma, and Wuyang Zhou. "Performance comparison of full-batch bp and mini-batch bp algorithm on spark framework." 2016 8th International Conference on Wireless Communications & Signal Processing (WCSP). IEEE, 2016.

Cited By

View all
  • (2023)Tg-Critic: A Timbre-Guided Model For Reference-Independent Singing EvaluationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10096309(1-5)Online publication date: 4-Jun-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ISCSIC 2019: Proceedings of the 2019 3rd International Symposium on Computer Science and Intelligent Control
September 2019
397 pages
ISBN:9781450376617
DOI:10.1145/3386164
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Deep Metric Learning
  2. Meta Learning
  3. Relation Network
  4. Singing Evaluation
  5. Triplet Network

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ISCSIC 2019

Acceptance Rates

ISCSIC 2019 Paper Acceptance Rate 77 of 152 submissions, 51%;
Overall Acceptance Rate 192 of 401 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)1
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Tg-Critic: A Timbre-Guided Model For Reference-Independent Singing EvaluationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10096309(1-5)Online publication date: 4-Jun-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media