Abstract
Estimating perceived audiovisual quality by user is a vital component in many multimedia networks and applications. The need of ground truth data for quality assessment leads to elaboration of subjective quality assessment databases. Over the years, several datasets dedicated to audiovisual quality have been released in the public domain that are built upon extensive psychophysical experiences. In this paper, we study four audiovisual quality datasets: PLYM, TUM1080p50, VQEG MM2, and INRS. We also present detailed description of each dataset with the intention to facilitate their use for the researchers’ community. Moreover, different summarization tables have been reported in order to accomplish clear and fair comparison between the audiovisual quality databases. It is hoped that the present work will help researchers in selecting the appropriate databases for their experimentations on objective audiovisual quality metrics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Akhtar, Z., Falk, T.H.: Audio-visual multimedia quality assessment: a comprehensive survey. IEEE Access 5, 21090–21117 (2017)
BT, R.I.R.: Methodology for the subjective assessment of the quality of television pictures. Int. Telecommun. Union (2002)
Demirbilek, E.: Modèles d’apprentissage automatique d’estimation de qualité perçue dans les communications en temps réel/Machine learning based perceived quality estimation models in realtime communications. Ph.D. thesis, Université du Québec, Institut national de la recherche scientifique (2017)
Fliegel, K.: QUALINET multimedia databases v5. 0. Czech Technical University in Prague, Faculty of Electrical Engineering, Multimedia Technology Group (2014)
Goudarzi, M., Sun, L., Ifeachor, E.: Audiovisual quality estimation for video calls in wireless applications. In: 2010 IEEE Global Telecommunications Conference GLOBECOM 2010, pp. 1–5. IEEE (2010)
Keimel, C., Redl, A., Diepold, K.: The TUM high definition video datasets. In: 2012 Fourth International Workshop on Quality of Multimedia Experience, pp. 97–102. IEEE (2012)
Pinson, M.H., et al.: The influence of subjects and environment on audiovisual subjective tests: an international study. IEEE J. Sel. Top. Sign. Proces. 6(6), 640–651 (2012)
Rec, I.: P. 920: Interactive test methods for audiovisual communications. Int. Telecommun. Union (1996)
Rec, I.: P. 1401, methods, metrics and procedures for statistical evaluation, qualification and comparison of objective quality prediction models. International Telecommunication Union, Geneva, Switzerland (2012)
Recommendation, I.: P. 910, subjective video quality assessment methods for multimedia applications. Technical report, International Telecommunication Union (2008)
Recommendation, I.: P. 913, methods for the subjective assessment of video quality, audio quality and audiovisual quality of internet video and distribution quality television in any environment. Int. Telecommun. Union (2016)
Saidi, I.: Analyse et modélisation de la qualité perçue des applications de visiophonie. Ph.D. thesis, INSA de Rennes (2018). https://tel.archives-ouvertes.fr/tel-01977199
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Boudjerida, F., Lahoulou, A., Akhtar, Z. (2021). Analysis and Comparison of Audiovisual Quality Assessment Datasets. In: Senouci, M.R., Boudaren, M.E.Y., Sebbak, F., Mataoui, M. (eds) Advances in Computing Systems and Applications. CSA 2020. Lecture Notes in Networks and Systems, vol 199. Springer, Cham. https://doi.org/10.1007/978-3-030-69418-0_31
Download citation
DOI: https://doi.org/10.1007/978-3-030-69418-0_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-69417-3
Online ISBN: 978-3-030-69418-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)