Article

Performance evaluation of object detection and tracking in video

Authors:

Vasant Manohar,

Padmanabhan Soundararajan,

Harish Raju,

Dmitry Goldgof,

Rangachar Kasturi,

John GarofoloAuthors Info & Claims

ACCV'06: Proceedings of the 7th Asian conference on Computer Vision - Volume Part II

Pages 151 - 161

https://doi.org/10.1007/11612704_16

Published: 13 January 2006 Publication History

Publisher Site

Abstract

The need for empirical evaluation metrics and algorithms is well acknowledged in the field of computer vision. The process leads to precise insights to understanding current technological capabilities and also helps in measuring progress. Hence designing good and meaningful performance measures is very critical.

In this paper, we propose two comprehensive measures, one each for detection and tracking, for video domains where an object bounding approach to ground truthing can be followed. Thorough analysis explaining the behavior of the measures for different types of detection and tracking errors are discussed. Face detection and tracking is chosen as a prototype task where such an evaluation is relevant. Results on real data comparing existing algorithms are presented and the measures are shown to be effective in capturing the accuracy of the detection/tracking systems.

References

[1]

Antani, S., Crandall, D., Narasimhamurthy, A., Mariano, V.Y., Kasturi, R.: Evaluation of Methods for Detection and Localization of Text in Video. In: Proceedings in International Workshop on Document Analysis Systems. (2000)

Google Scholar

[2]

Black, J., Ellis, T.J., Rosin, P.: A Novel Method for Video Tracking Performance Evaluation. In: Proceedings of IEEE PETS Workshop. (2003)

Google Scholar

[3]

Brown, L.M., Senior, A.W., Tian, Y., Connell, J., Hampapur, A., Shu, C., Merkl, H., Lu, M.: Performance Evaluation of Surveillance Systems Under Varying Conditions. In: Proceedings of IEEE PETS Workshop. (2005)

Google Scholar

[4]

Collins, R., Zhou, X., Teh, S.: An Open Source Tracking Testbed and Evaluation Web Site. In: Proceedings of IEEE PETS Workshop. (2005)

Google Scholar

[5]

Fisher, R.B.: The PETS04 Surveillance Ground-Truth Data Sets. In: Proceedings of IEEE PETS Workshop. (2004)

Google Scholar

[6]

Hua, X., Wenyin, L., Zhang, H.: Automatic Performance Evaluation for Video Text Detection. In: Proc. International Conference on Document Analysis and Recognition. (2001)

Crossref

Google Scholar

[7]

Nascimento, J., Marques, J.: New Performance Evaluation Metrics for Object Detection Algorithms. In: Proceedings of IEEE PETS Workshop. (2004)

Google Scholar

[8]

Smith, K., Gatica-Perez, D., Odobez, J., Ba, S.: Evaluating Multi-Object Tracking. In: Proceedings of IEEE Empirical Evaluation Methods in Computer Vision Workshop. (2005)

Crossref

Google Scholar

[9]

Doermann, D., Mihalcik, D.: Tools and Techniques for Video Performance Evaluation. In: ICPR. Volume 4. (2000) 167-170

Google Scholar

[10]

Munkres, J.R.: Algorithms for the Assignment and Transportation Problems. J. SIAM 5 (1957) 32-38

Google Scholar

[11]

Fredman, M.L., Tarjan, R.E.: Fibonacci Heaps and their uses in Improved Network Optimization Algorithms. Journal of ACM 34 (1987) 596-615

Crossref

Google Scholar

Cited By

View all

Li BJohan HYe YLu Y(2014)Efficient view-based 3d reflection symmetry detectionSIGGRAPH Asia 2014 Creative Shape Modeling and Design10.1145/2669043.2669045(1-8)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2669043.2669045
Akdere MHwang JCetintemel UChakravarthy SUrban SPietzuch PRundensteiner E(2013)Real-time probabilistic data association over streamsProceedings of the 7th ACM international conference on Distributed event-based systems10.1145/2488222.2488346(219-230)Online publication date: 29-Jun-2013
https://dl.acm.org/doi/10.1145/2488222.2488346
Cozzolino AFlammini FGalli VLamberti MPoggi GPragliola C(2012)Evaluating the effects of MJPEG compression on motion tracking in metro railway surveillanceProceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems10.1007/978-3-642-33140-4_13(142-154)Online publication date: 4-Sep-2012
https://dl.acm.org/doi/10.1007/978-3-642-33140-4_13
Show More Cited By

Performance evaluation of object detection and tracking in video
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks

Recommendations

Multi-object detection and tracking by stereo vision

This paper presents a new stereo vision-based model for multi-object detection and tracking in surveillance systems. Unlike most existing monocular camera-based systems, a stereo vision system is constructed in our model to overcome the problems of ...
Multi-Object Tracking in Airborne Video Imagery based on Compressive Tracking Detection Responses
MoMM 2015: Proceedings of the 13th International Conference on Advances in Mobile Computing and Multimedia

Multi-object tracking (MOT) in airborne video is a challenging problem due to the uncertain airborne vehicle motion as well as mounted camera vibrations. Most approaches addressing tracking in such type of scenario, use data association based on motion ...
Multi-object tracking with inter-feedback between detection and tracking

Multi-object tracking is an important but challenging task in computer vision. Tremendous investigations have been made on the topics, among which tracking-by-detection method first detects objects independently at each frame and then links the detected ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACCV'06: Proceedings of the 7th Asian conference on Computer Vision - Volume Part II

January 2006

972 pages

ISBN:3540312447

Editors:
P. J. Narayanan
Center for Visual Information Technology, International Institute of Information Technology, Hyderabad, India
,
Shree K. Nayar
Department of Computer Science, Columbia University, 500 West 120th Street, New York, India
,
Heung-Yeung Shum
Department of Computer Science, Microsoft Research Asia, 500 West 120th Street, Beijing, P.R. China

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 13 January 2006

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li BJohan HYe YLu Y(2014)Efficient view-based 3d reflection symmetry detectionSIGGRAPH Asia 2014 Creative Shape Modeling and Design10.1145/2669043.2669045(1-8)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2669043.2669045
Akdere MHwang JCetintemel UChakravarthy SUrban SPietzuch PRundensteiner E(2013)Real-time probabilistic data association over streamsProceedings of the 7th ACM international conference on Distributed event-based systems10.1145/2488222.2488346(219-230)Online publication date: 29-Jun-2013
https://dl.acm.org/doi/10.1145/2488222.2488346
Cozzolino AFlammini FGalli VLamberti MPoggi GPragliola C(2012)Evaluating the effects of MJPEG compression on motion tracking in metro railway surveillanceProceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems10.1007/978-3-642-33140-4_13(142-154)Online publication date: 4-Sep-2012
https://dl.acm.org/doi/10.1007/978-3-642-33140-4_13
Schneider NGehrig SPfeiffer DBanitsas K(2011)An evaluation framework for stereo-based driver assistanceProceedings of the 15th international conference on Theoretical Foundations of Computer Vision: outdoor and large-scale real-world scene analysis10.1007/978-3-642-34091-8_2(27-51)Online publication date: 26-Jun-2011
https://dl.acm.org/doi/10.1007/978-3-642-34091-8_2
Tomasi MDíaz JRos E(2007)Real time architectures for moving-objects trackingProceedings of the 3rd international conference on Reconfigurable computing: architectures, tools and applications10.5555/1764631.1764673(365-372)Online publication date: 27-Mar-2007
https://dl.acm.org/doi/10.5555/1764631.1764673
Manohar VSoundararajan PBoonstra MRaju HGoldgof DKasturi RGarofolo J(2006)Performance evaluation of text detection and tracking in videoProceedings of the 7th international conference on Document Analysis Systems10.1007/11669487_51(576-587)Online publication date: 13-Feb-2006
https://dl.acm.org/doi/10.1007/11669487_51

Abstract

References

Cited By

Recommendations

Multi-object detection and tracking by stereo vision

Multi-Object Tracking in Airborne Video Imagery based on Compressive Tracking Detection Responses

Multi-object tracking with inter-feedback between detection and tracking

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations