[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Fast moving pedestrian detection based on motion segmentation and new motion features

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The detection of moving pedestrians is of major importance for intelligent vehicles, since information about such persons and their tracks should be incorporated into reliable collision avoidance algorithms. In this paper, we propose a new approach to detect moving pedestrians aided by motion analysis. Our main contribution is to use motion information in two ways: on the one hand we localize blobs of moving objects for regions of interest (ROIs) selection by segmentation of an optical flow field in a pre-processing step, so as to significantly reduce the number of detection windows needed to be evaluated by a subsequent people classifier, resulting in a fast method suitable for real-time systems. On the other hand we designed a novel kind of features called Motion Self Difference (MSD) features as a complement to single image appearance features, e. g. Histograms of Oriented Gradients (HOG), to improve distinctness and thus classifier performance. Furthermore, we integrate our novel features in a two-layer classification scheme combining a HOG+Support Vector Machines (SVM) and a MSD+SVM detector. Experimental results on the Daimler mono moving pedestrian detection benchmark show that our approach obtains a log-average miss rate of 36 % in the FPPI range [10−2,100], which is a clear improvement with respect to the naive HOG+SVM approach and better than several other state-of-the-art detectors. Moreover, our approach also reduces runtime per frame by an order of magnitude.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Regulated ground truth annotations can be downloaded at http://www.iai.uni-bonn.de/∼zhangs

  2. http://www.vision.caltech.edu/Image_Datasets/CaltechPedestrians

References

  1. Benenson R, Mathias M, Timofte R, Van Gool L (2012) Pedestrian detection at 100 frames per second. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  2. Bertozzi M, Broggi A, Chapuis R, Chausse F, Fascioli A, Tibaldi A (2003) Shape-based pedestrian detection and localization. In: Proceedings of the IEEE conference on intelligent transportation systems

  3. Bertozzi M, Broggi A, Fascioli A, Tibaldi A, Chapuis R, Chausse F (2004) Pedestrian localization and tracking system with kalman filtering. In: Proceedings of the IEEE intelligent vehicles symposium

  4. Bouchrika I, Carter JN, Nixon MS, Mörzinger R, Thallinger G (2010) Using gait features for improving walking people detection. In: Proceedings of the international conference on pattern recognition

  5. Broggi A, Fascioli A, Fedriga I, Tibaldi A, Rose M (2003) Stereo-based preprocessing for human shape localization in unstructured environments. In: Proceedings of the IEEE intelligent vehicles symposium

  6. Chen K, Wang L, Chi H (1997) Methods of combining multiple classifiers with different features and their applications to text-independent speaker identification. Int J Pattern Recog Artif Intell 11(3):417–445

    Article  Google Scholar 

  7. Curio C, Edelbrunner J, Kalinke T, Tzomakas C, Von Seelen W (2000) Walking pedestrian recognition. IEEE Trans Intell Transport Syst 1(3):155–163

    Article  Google Scholar 

  8. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  9. Dalal N, Triggs B, Schmid C (2006) Human detection using oriented histograms of flow and appearance. In: Proceedings of the European conference on computer vision

  10. Ding J, Wang Y, Geng W (2013) An hog-ct human detector with histogram-based search. Multimed Tools Appl 63(3):791–807

    Article  Google Scholar 

  11. Dollár P, Wojek C, Schiele B, Perona P (2011) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761

    Article  Google Scholar 

  12. Elzein H, Lakshmanan S, Watta P (2003) A motion and shape-based pedestrian detection algorithm. In: Proceedings of the IEEE intelligent vehicles symposium

  13. Enzweiler M, Gavrila DM (2009) Monocular pedestrian detection: survey and experiments, vol 31

  14. Enzweiler M, Kanter P, Gavrila DM (2008) Monocular pedestrian recognition using motion parallax. In: Proceedings of the IEEE intelligent vehicles symposium

  15. Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181

    Article  Google Scholar 

  16. Felzenszwalb PF, McAllester D, Ramanan D (2008) A discriminatively trained, multiscale, deformable part model. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  17. Franke U, Heinrich S (2002) Fast obstacle detection for urban traffic situations. IEEE Trans Intell Transp Syst 3(3):173–181

    Article  Google Scholar 

  18. Gavrila DM, Munder S (2007) Multi-cue pedestrian detection and tracking from a moving vehicle. Int J Comput Vis 73(1):41–59

    Article  Google Scholar 

  19. Gerónimo D, López AM, Sappa AD, Graf T (2010) Survey of pedestrian detection for advanced driver assistance systems. IEEE Trans Pattern Anal Mach Intell 32(7):1239–1258

    Article  Google Scholar 

  20. Gualdi G, Prati A, Cucchiara R (2010) Multi-stage sampling with boosting cascades for pedestrian detection in images and videos. In: Proceedings of the European conference on computer vision

  21. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  22. Kamijo S, Fujimura K, Shibayama Y (2010) Pedestrian detection algorithm for on-board cameras of multi view angles. In: Proceedings of the IEEE intelligent vehicles symposium

  23. Kamijo S, Matsushita Y, Ikeuchi K, Sakauchi M (2000) Occlusion robust tracking utilizing spatio-temporal markov random field model. In: Proceedings of the international conference on pattern recognition

  24. Leibe B, Cornelis N, Cornelis K, Van Gool L (2007) Dynamic 3d scene analysis from a moving vehicle. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  25. Lim J, Kim W (2013) Detecting and tracking of multiple pedestrians using motion, color information and the adaboost algorithm. Multimed Tools Appl 65(1):161–179

    Article  MathSciNet  Google Scholar 

  26. Liu C (2009) Beyond pixels: exploring new representations and applications for motion analysis. Ph.D. thesis, Massachusetts Institute of Technology

  27. Maji S, Berg AC, Malik J (2008) Classification using intersection kernel support vector machines is efficient. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  28. Park D, Zitnick CL, Ramanan D, Dollár P (2013) Exploring weak stabilization for motion feature extraction. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  29. Sabzmeydani P, Mori G (2007) Detecting pedestrians by learning shapelet features. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  30. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  31. Walk S, Majer N, Schindler K, Schiele B (2010) New features and insights for pedestrian detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  32. Wang X, Han TX (2009) An HOG-LBP human detector with partial occlusion handling. In: Proceedings of the international conference on computer vision

  33. Wojek C, Schiele B (2008) A performance evaluation of single and multi-feature people detection. In: Proceedings of the symposium of the german association for pattern recognition (DAGM)

  34. Wojek C, Walk S, Schiele B (2009) Multi-cue onboard pedestrian detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  35. Zhang S, Bauckhage C, Cremers A (2014) Informed haar-like features improve pedestrian detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  36. Zhang S, Bauckhage C, Klein D, Cremers A (2013) Moving pedestrian detection based on motion segmentation. In: Proceedings of the IEEE workshop on robot vision (WoRV)

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Science III, University of Bonn, Römerstraße 164, 53117, Bonn, Germany

    Shanshan Zhang & Armin B. Cremers

  2. Fraunhofer FKIE, Fraunhoferstraße 20, 53343, Wachtberg, Germany

    Dominik A. Klein

  3. Fraunhofer IAIS, Schloss Birlinghoven, 53757, Sankt Augustin, Germany

    Christian Bauckhage

Authors
  1. Shanshan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dominik A. Klein
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christian Bauckhage
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Armin B. Cremers
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shanshan Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, S., Klein, D.A., Bauckhage, C. et al. Fast moving pedestrian detection based on motion segmentation and new motion features. Multimed Tools Appl 75, 6263–6282 (2016). https://doi.org/10.1007/s11042-015-2571-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2571-z

Keywords

Search

Navigation