Abstract
There are several approaches for performance evaluation of image processing algorithms in video-based surveillance systems: Precision/ Recall, Receiver Operator Characteristics (ROC), F-measure, Jaccard Coefficient, etc. These measures can be used to find good values for input parameters of image segmentation algorithms. Different measures can give different values of these parameters, considered as optimal by one criterion, but not by another. Most of the times, the measures are expressed as a compromise between two of the three aspects that are important for a quality assessment: Precision, Recall and Specificity. In this paper, we propose a new 3-dimensional measure (D prs ), which takes into account all of the three aspects. It can be considered as a 3D generalization of 2D ROC analysis and Precision/Recall curves. To estimate the impact of parameters on the quality of the segmentation, we study the behavior of this measure and compare it with several classical measures. Both objective and subjective evaluations confirm that our new measure allows to determine more stable parameters than classical criteria, and to obtain better segmentations of images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Nascimento, J., Marques, J.: Performance evaluation of object detection algorithms for video surveillance. IEEE Transactions on Multimedia 8, 761–777 (2006)
Rosin, P.L., Ioannidis, E.: Evaluattion of Global Image Thresholding for Change Detection. Pattern Recognition Letter 24, 345–2356 (2003)
Elhabian, S., El-Sayed, K.: Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art. Recent Patents on Computer Science 1, 32–54 (2008)
Gao, X., Boult, T.E., Coetzee, F., Ramesh, V.: Error analysis of background adaptation. In: Computer Vision and Pattern Recognition, vol. 1, pp. 503–510 (2000)
Davis, J., Burnside, E., Dutra, I., Page, D., Ramakrishnan, R., Santos Costa, V., Shavlik, J.: View learning for statistical relational learning: With an application to mammography. In: Proceeding of the 19th International Joint Conference on Artificial Intelligence, pp. 677–683 (2005)
Davis, J., Goadrich, M.: The Relationship between Precision-Recall and ROC Curves. In: International Conference on Machine Learning, pp. 233–240 (2006)
Wang, S., Chang, C.I., Yang, S.C., Hsu, G.C., Hsu, H.H., Chung, P.C., Guo, S.M., Lee, S.K.: 3D ROC Analysis for Medical Imaging Diagnosis. Engineering in Medicine and Biology Society, 7545–7548 (2005)
Chen, Y.T., Chen, C.S., Huang, C.R., Hung, Y.P.: Efficient hierarchical method for background subtraction. Pattern Recognition, 2706–2715 (2007)
Dhome, Y., Tronson, N., Vacavant, A.: A Benchmark for Background Subtraction Algorithms in Monocular Vision: A Comparative Study. Image Processing Theory Tools and Applications (IPTA), 7–10 (2010)
Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 246–252 (1999)
Huang, C.R., Chen, C.S., Chung, P.C.: Contrast context histogram A discriminating local descriptor for image matching. In: Proceedings of IEEE International Conference on Pattern Recognition, vol. 4, pp. 53–56 (2006)
Chateau, T.: Visage Challenge: Video-surveillance Intelligente: Systemes et AlGorithmES (2012), http://visage.univ-bpclermont.fr/?q=node/2
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Intawong, K., Scuturici, M., Miguet, S. (2013). A New Pixel-Based Quality Measure for Segmentation Algorithms Integrating Precision, Recall and Specificity. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds) Computer Analysis of Images and Patterns. CAIP 2013. Lecture Notes in Computer Science, vol 8047. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40261-6_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-40261-6_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40260-9
Online ISBN: 978-3-642-40261-6
eBook Packages: Computer ScienceComputer Science (R0)