Real time multiple people tracking and pose estimation
Pages 5 - 10
Abstract
In this paper we present a combined probability estimation approach to detect and track multiple people for pose estimation at the same time. It can deal with partial and total occlusion between persons by adding torso appearance to the tracker. Moreover, the upper body of each individual is further segmented into head, torso, upper arm and lower arm in a hierarchical way. The simplicity of the feature and the simplified model allow close real time performance of the tracker. The experimental results show that the proposed method can deal with most of the inner-occlusion between persons, as well as certain self-occlusion. It's also much faster than the existing methods with comparable accuracy.
References
[1]
Moeslund, T. B., Hilton, A. and Kruger, V. 2006. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104, (Nov. 2006), 90--126.
[2]
Huo, F., Hendriks, E. A., Oomes, A.H.J., van Beek, P. and Veltkamp, R. 2009. Detection tracking and recognition of human poses for a real time spatial game. In Proceedings of the CASA Workshop on 3D Advanced Media In Gaming And Simulation (Amsterdam, The Netherlands, June 16, 2009), 43--51.
[3]
Jiang, H. 2009. Human pose estimation using consistent max-covering. In Proceedings of the IEEE International Conference on Computer Vision (Tokyo, Japan, Sept. 29 - Oct. 2, 2009), 1357--1364.
[4]
Gupta, A., Mittal, A. and Davis, L.S. 2008. Constraint integration for efficient multiview pose estimation with self-occlusions. IEEE Trans on Pattern Analysis and Machine Intelligence, 30, 3 (March 2008), 493--506.
[5]
Ramanan, D., Forsyth, D.A., and Zisserman, A. 2007. Tracking people by learning their appearance. IEEE Trans on Pattern Analysis and Machine Intelligence, 29, 1 (Jan.2007), 65--81.
[6]
Micilotta, A. 2005. Detection and tracking of humans for visual interaction. Doctoral Thesis, School of Electronics and Physical Sciences, University of Surrey.
[7]
Stauffer, C. and Grimson, W. 1999. Adaptive background mixture models for real-time tracking. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Ft. Collins, CO, USA, June 23 - 25, 1999), 246--252.
[8]
Porikli, F.M., and Tuzel, O. 2003. Human body tracking by adaptive background models and mean-shift analysis. In Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (Graz, Austria, March 31, 2003).
[9]
Comaniciu, D., Ramesh, V. and Meer, P. 2003. Kernel-based object tracking. IEEE Trans on Pattern Analysis and Machine Intelligence, 25, 5 (May 2003), 564--577.
[10]
Huo, F., Hendriks, E. A., Paclik, P. and Oomes, A.H.J. 2009. Markerless human motion capture and pose recognition. In Proceedings of International Workshop on Image Analysis for Multimedia Interactive Services (London, United Kingdom, May 6 - 8, 2009), 13--16.
[11]
Sigal, L., Bhatia, S., Roth, S., Black, M. J., and Isard, M. 2004. Tracking loose-limbed people. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Washington, DC, USA, June 27 - July 2, 2004), 421--428.
[12]
Lee, M.W., and Nevatia, R. 2009. Human pose tracking in monocular sequence using multilevel structured models. IEEE Trans on Pattern Analysis and Machine Intelligence, 31, 1 (Jan. 2009), 27--38.
[13]
Deutscher, J. and Reid, I. 2005. Articulated body motion capture by stochastic search. International Journal of Computer Vision, 61, 2 (Feb. 2005), 185--205.
[14]
Balan, A. O., and Black, M. J. 2006. An adaptive appearance model approach for model-based articulated object tracking. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (New York City, USA, June 17 - 22, 2006), 421--428.
[15]
Li, Y. and Sun, Z. 2009. Vision-based human pose estimation for pervasive computing. In Proceedings of the ACM workshop on Ambient Media Computing (Beijing, China, Oct. 23, 2009), 49--56.
[16]
Salti, S., Schreer, O. and Stefano, L. D. 2008. Real-time 3d arm pose estimation from monocular video for enhanced HCI. In Proceeding of the 1st ACM workshop on Vision Networks for Behavior Analysis (Vancouver, British Columbia, Canada, Oct. 31, 2008), 1--8.
[17]
Cho, S.H., and Kim, D. 2008. Pose robust human detection using multiple oriented 2d elliptical filters. In Proceedings of the 1st ACM workshop on Vision Networks for Behavior Analysis (Vancouver, British Columbia, Canada, Oct. 31, 2008), 9--16.
[18]
Chadwicke, O., Gonzalez, G. and Loper, M. M. 2007. Tracking human motion and actions for interactive robots. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction (Arlington, Virginia, USA, March 8 - 11, 2007), 365--372.
[19]
Jung, J., Cho, K. and Yang, H. S. 2009. Real-time robust body part tracking for augmented reality interface. In Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry (Yokohama, Japan, Dec. 14 - 15, 2009), 203--207.
[20]
Sigal, L., Balan, A. O., and Black, M. J. 2010.HumanEva: synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International Journal of Computer Vision, 87, 1 (March 2010), 4--27.
[21]
Peursum, P., Venkatesh, S. and West, G. 2010. A study on smoothing for particle-filtered 3D human body tracking. International Journal of Computer Vision, 87, 1 (March 2010), 53--74.
Index Terms
- Real time multiple people tracking and pose estimation
Recommendations
Multiple people tracking and pose estimation with occlusion estimation
Simultaneously tracking poses of multiple people is a difficult problem because of inter-person occlusions and self occlusions. This paper presents an approach that circumvents this problem by performing tracking based on observations from multiple wide-...
Real-time camera pose estimation via line tracking
Real-time camera calibration has been intensively studied in augmented reality. However, for texture-less and texture-repeated scenes as well as poorly illuminated scenes, obtaining a stable calibration is still an open problem. In the paper, we propose ...
Detection and Tracking of Occluded People
We consider the problem of detection and tracking of multiple people in crowded street scenes. State-of-the-art methods perform well in scenes with relatively few people, but are severely challenged by scenes with many subjects that partially occlude ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2010
68 pages
ISBN:9781450301671
DOI:10.1145/1878039
- General Chairs:
- Hamid Aghajan,
- Marco Cristani,
- Vittorio Murino,
- Nicu Manuel Sebe
Copyright © 2010 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 October 2010
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MM '10
Sponsor:
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 235Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 31 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in