More Web Proxy on the site http://driver.im/

article

Multi-object detection and tracking by stereo vision

Authors:

Xin YangAuthors Info & Claims

Pattern Recognition, Volume 43, Issue 12

Pages 4028 - 4041

https://doi.org/10.1016/j.patcog.2010.06.012

Published: 01 December 2010 Publication History

Abstract

This paper presents a new stereo vision-based model for multi-object detection and tracking in surveillance systems. Unlike most existing monocular camera-based systems, a stereo vision system is constructed in our model to overcome the problems of illumination variation, shadow interference, and object occlusion. In each frame, a sparse set of feature points are identified in the camera coordinate system, and then projected to the 2D ground plane. A kernel-based clustering algorithm is proposed to group the projected points according to their height values and locations on the plane. By producing clusters, the number, position, and orientation of objects in the surveillance scene can be determined for online multi-object detection and tracking. Experiments on both indoor and outdoor applications with complex scenes show the advantages of the proposed system.

References

[1]

Lee, D., Effective Gaussian mixture learning for video background subtraction. IEEE Trans. Pattern Anal. Mach. Intell. v27 i5. 827-832.

[2]

Sheikh, Y. and Shah, M., Bayesian modeling of dynamic scenes for object detection. IEEE Trans. Pattern Anal. Mach. Intell. v27 i11. 1778-1792.

[3]

Parageorgiou, C., Oren, M. and Poggio, T., A general framework for object detection. In: International Conference on Computer Vision, pp. 552-562.

[4]

Viola, P., Jones, M. and Snow, D., Detecting pedestrians using patterns of motion and appearance. In: International Conference on Computer Vision, pp. 734-741.

[5]

Dalal, N. and Triggs, B., Histograms of oriented gradients for human detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 886-893.

Digital Library

[6]

Isard, M. and Blake, A., Condensation-conditional density propagation for visual tracking. Int. J. Comput. Vision. v29 i1. 5-28.

[7]

Comaniciu, D., Ramesh, V. and Meer, P., Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. v25 i5. 564-575.

[8]

Nikos, P. and Rachid, D., Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Trans. Pattern Anal. Mach. Intell. v22 i3. 266-280.

[9]

Zimmermann, K., Matas, J. and Svoboda, T., Tracking by an optimal sequence of linear predictors. IEEE Trans. Pattern Anal. Mach. Intell. v31 i4. 677-692.

[10]

Moreno-Noguer, F., Sanfeliu, A. and Samaras, D., A target dependent colorspace for robust tracking. In: Proceedings of the International Conference on Pattern Recognition, pp. 43-46.

Digital Library

[11]

Collins, R., Liu, Y. and Leordeanu, M., On-line selection of discriminative tracking features. IEEE Trans. Pattern Anal. Mach. Intell. v27 i10. 1631-1643.

[12]

Ozyildiz, E., Krahnstover, N. and Sharma, R., Adaptive texture and color segmentation for tracking moving objects. Pattern Recognition. v35 i10. 2013-2029.

[13]

Takala, V. and Pietikinen, M., Multi-object tracking using color, texture and motion. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-7.

[14]

Horprasert, T., Harwood, D. and Davis, L.S., A statistical approach for real-time robust background subtraction and shadow detection. In: International Conference on Computer Vision, pp. 1-19.

[15]

Mikic, I., Cosman, P.C., Kogut, G.T. and Trivedi, M.M., Moving shadow and object detection in traffic scenes. In: Proceedings of the International Conference on Pattern Recognition, pp. 1321

[16]

Stauder, J., Mech, R. and Ostermann, J., Detection of moving cast shadows for object segmentation. IEEE Trans. Multimedia. v1 i1. 65-76.

[17]

Prati, A., Mikic, I., Trivedi, M.M. and Cucchiara, R., Detecting moving shadows: algorithms and evaluation. IEEE Trans. Pattern Anal. Mach. Intell. v25 i7. 918-923.

[18]

Nadimi, S. and Bhanu, B., Physical models for moving shadow and object detection in video. IEEE Trans. Pattern Anal. Mach. Intell. v26 i8. 1079-1087.

[19]

Paragios, N. and Deriche, R., Detecting multiple moving targets using deformable contours. In: Proceedings of the International Conference on Image Processing, pp. 26-29.

[20]

Paragios, N. and Deriche, R., A PDE-based level set approach for detection and tracking of moving objects. In: International Conference on Computer Vision, pp. 1139-1145.

[21]

MacCormick, J. and Blake, A., A probabilistic exclusion principle for tracking multiple objects. Int. J. Comput. Vision. v39 i1. 57-71.

[22]

Wolf, J.K., Viterbi, A.M. and Dixson, G.S., Finding the best set of K paths through a trellis with application to multitarget tracking. IEEE Trans. Aerosp. Electron. Syst. v25 i2. 287-296.

[23]

Jiang, H., Fels, S. and Little, J., Optimizing multiple object tracking and best view video synthesis. IEEE Trans. Multimedia. v10 i6. 997-1012.

[24]

Li, Y., Huang, C. and Nevatia, R., Learning to associate: hybridboosted multi-target tracker for crowded scene. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2953-2960.

[25]

Pinho, R. and Tavares, J., Tracking features in image sequences with Kalman filtering, global optimization, mahalanobis distance and a management model. Comput. Modeling Eng. Sci. v46 i1. 51-75.

[26]

Dockstader, S. and Murat, T.A., Multiple camera tracking of interacting and occluded human motion. In: Proceedings of IEEE, pp. 1441-1455.

[27]

Mittal, A. and Davis, L., M2Tracker: a multi-view approach to segmenting and tracking people in a cluttered scene using region-based stereo. In: European Conference on Computer Vision, pp. 18-36.

[28]

Khan, S. and Shah, M., A multiview approach to tracking people in crowded scenes using a planar homography constraint. In: European Conference on Computing Vision, pp. 133-146.

[29]

Berclaz, J., Fleuret, F. and Fua, P., Multi-camera tracking and atypical motion detection with behavioral maps. In: European Conference on Computing Vision, pp. 112-125.

[30]

Darrell, T., Gordon, G., Harville, M. and Woodfill, J., Integrated person tracking using stereo, color, and pattern detection. Int. J. Comput. Vision. v37 i2. 175-185.

[31]

Darrell, T., Demirdjian, D., Checka, N. and Felzenszwalb, P., Plan-view trajectory estimation with dense stereo background models. In: International Conference on Computer Vision, pp. 628-635.

[32]

Huang, X., Li, L. and Sim, T., Stereo-based human head detection from crowd scenes. In: Proceedings of the International Conference on Image Processing, pp. 1353-1356.

[33]

Zimmermann, K., Svoboda, T. and Matas, J., Multi-view 3d tracking with an incrementally constructed 3d model. In: Proceedings of the Third International Symposium on 3D Data Processing, pp. 14-16.

[34]

M. Mozerov, I. Rius, X. Roca, J. Gonzlez, Nonlinear synchronization for automatic learning of 3D pose variability in human motion sequences, EURASIP Journal on Advances in Signal Processing 2010 (2010) Article ID 507247, 10 pages.

Digital Library

[35]

Zhang, Z., A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. v22 i11. 1330-1334.

[36]

Fusiello, A., Trucco, E. and Verri, A., A compact algorithm for rectification of stereo pairs. Mach. Vision Appl. v12 i1. 16-22.

[37]

Birchfield, S. and Tomasi, C., Depth discontinuities by pixel-to-pixel stereo. Int. J. Comput. Vision. v35 i3. 269-293.

[38]

Kim, J., Kolmogorov, V. and Zabih, R., Visual correspondence using energy minimization and mutual information. In: International Conference on Computer Vision, pp. 1033-1040.

[39]

Lobo, J., Almeida, L., Alves, J. and Dias, J., Registration and segmentation for 3D map building-a solution based on stereo vision and inertial sensors. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 139-144.

[40]

Lobo, J. and Dias, J., Inertial sensed ego-motion for 3D vision. J. Robotics Syst. v21 i1. 3-12.

[41]

Fukunaga, K. and Hostetler, L.D., The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory. v22 i1. 32-40.

[42]

Cheng, Y., Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. v17 i8. 790-799.

[43]

Comaniciu, D. and Meer, P., Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. v24 i5. 603-619.

[44]

Collins, R., Mean-shift blob tracking through scale space. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 234-240.

Cited By

Yoshida TOkazaki NTakaki KHirose MKitagawa SInami M(2022)Flexel: A Modular Floor Interface for Room-Scale Tactile SensingProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545699(1-12)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545699
Lian JWang ZLi LZhou YYin YLi L(2020)A real-time traffic environmental perception algorithm fusing stereo vision and deep networkJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-19191739:1(975-986)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.3233/JIFS-191917
Mahalingam TSubramoniam M(2020)ACO–MKFCM: An Optimized Object Detection and Tracking Using DNN and Gravitational Search AlgorithmWireless Personal Communications: An International Journal10.1007/s11277-019-06802-3110:3(1567-1604)Online publication date: 1-Feb-2020
https://dl.acm.org/doi/10.1007/s11277-019-06802-3
Show More Cited By

Multi-object detection and tracking by stereo vision
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks

Recommendations

Stereo Vision Tracking System
ICFCC '09: Proceedings of the 2009 International Conference on Future Computer and Communication

Target tracking has become an area of interest in recent years. Target tracking is able to widen the perspective and view of the static camera to track a target, providing basic artificial intelligence features for robots, and serve as the platform for ...
Catadioptric Stereo Using Planar Mirrors

By using mirror reflections of a scene, stereo images can be captured with a single camera (catadioptric stereo). In addition to simplifying data acquisition single camera stereo provides both geometric and radiometric advantages over traditional two ...
Stereo vision using two PTZ cameras

The research of traditional stereo vision is mainly based on static cameras. As PTZ (Pan-Tilt-Zoom) cameras are able to obtain multi-view-angle and multi-resolution information, they have received more and more concern in both research and real ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Pattern Recognition

Pattern Recognition Volume 43, Issue 12

December, 2010

276 pages

ISSN:0031-3203

Issue’s Table of Contents

Copyright © Elsevier Ltd © 2010.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 December 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yoshida TOkazaki NTakaki KHirose MKitagawa SInami M(2022)Flexel: A Modular Floor Interface for Room-Scale Tactile SensingProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545699(1-12)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545699
Lian JWang ZLi LZhou YYin YLi L(2020)A real-time traffic environmental perception algorithm fusing stereo vision and deep networkJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-19191739:1(975-986)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.3233/JIFS-191917
Mahalingam TSubramoniam M(2020)ACO–MKFCM: An Optimized Object Detection and Tracking Using DNN and Gravitational Search AlgorithmWireless Personal Communications: An International Journal10.1007/s11277-019-06802-3110:3(1567-1604)Online publication date: 1-Feb-2020
https://dl.acm.org/doi/10.1007/s11277-019-06802-3
Mahalingam TSubramoniam M(2020)Optimal object detection and tracking in occluded video using DNN and gravitational search algorithmSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-020-05407-424:24(18301-18320)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s00500-020-05407-4
Neumann DLangner TUlbrich FSpitta DGoehring D(2017)Online vehicle detection using Haar-like, LBP and HOG feature based image classifiers with stereo vision preselection2017 IEEE Intelligent Vehicles Symposium (IV)10.1109/IVS.2017.7995810(773-778)Online publication date: 11-Jun-2017
https://dl.acm.org/doi/10.1109/IVS.2017.7995810
Sankowski WWodarczyk MKacperski DGrabowski K(2017)Estimation of measurement uncertainty in stereo vision systemImage and Vision Computing10.1016/j.imavis.2017.02.00561:C(70-81)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.imavis.2017.02.005
Ortigosa NMorillas S(2014)Fuzzy Free Path Detection from Disparity Maps by Using Least-Squares Fitting to a PlaneJournal of Intelligent and Robotic Systems10.1007/s10846-013-9997-175:2(313-330)Online publication date: 1-Aug-2014
https://dl.acm.org/doi/10.1007/s10846-013-9997-1
Zhou XLi YHe B(2013)Game-theoretical occlusion handling for multi-target visual trackingPattern Recognition10.1016/j.patcog.2013.02.01346:10(2670-2684)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.1016/j.patcog.2013.02.013
Kalarot RGimel'farb GMorris J(2012)3D object tracking with a high-resolution GPU based real-time stereoProceedings of the 27th Conference on Image and Vision Computing New Zealand10.1145/2425836.2425912(394-399)Online publication date: 26-Nov-2012
https://dl.acm.org/doi/10.1145/2425836.2425912
Pei ZZhang YYang TZhang XYang Y(2012)A novel multi-object detection method in complex scene using synthetic aperture imagingPattern Recognition10.1016/j.patcog.2011.10.00345:4(1637-1658)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1016/j.patcog.2011.10.003

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents