Abstract
We design an effective shape prior embedded human silhouettes extraction algorithm. Human silhouette extraction is found challenging because of articulated structures, pose variations, and background clutters. Many segmentation algorithms, including the Min-Cut algorithm, meet difficulties in human silhouette extraction. We aim at improving the performance of the Min-Cut algorithm by embedding shape prior knowledge. Unfortunately, seeking shape priors automatically is not trivial especially for human silhouettes. In this work, we present a shape sequence matching method that searches for the best path in spatial-temporal domain. The path contains shape priors of human silhouettes that can improve the segmentation. Matching shape sequences in spatial-temporal domain is advantageous over finding shape priors by matching shape templates with a single likelihood frame because errors can be avoided by searching for the global optimization in the domain. However, the matching in spatial-temporal domain is computationally intensive, which makes many shape matching methods impractical. We propose a novel shape matching approach that has low computational complexity independent of the number of shape templates. In addition, we investigate on how to make use of shape priors in a more adequate way. Embedding shape priors into the Min-Cut algorithm based on distances from shape templates is lacking because Euclidean distances cannot represent shape knowledge in a fully appropriate way. We embed distance and orientation information of shape priors simultaneously into the Min-Cut algorithm. Experimental results demonstrate that our algorithm is efficient and practical. Compared with previous works, our silhouettes extraction system produces better segmentation results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Wang, J., Makihara, Y., Yagi, Y.: Human tracking and segmentation supported by silhouette-based gait recognition. In: Proc. of IEEE Int. Conf. on Robotics and Automation (2008)
Freedman, D., Zhang, T.: Interactive graph cut based segmentation with shape priors. In: Proc. of CVPR, pp. 755–762 (2004)
Boykov, Y., Jolly, M.P.: Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In: Proc. of ICCV, pp. 105–112 (2001)
Wang, J., Makihara, Y., Yagi, Y.: People tracking and segmentation using spatiotemporal shape constraints. In: Proc. of 1st ACM International Workshop on Vision Networks for Behavior Analysis, in conjunction with ACM Multimedia (2008)
Baumberg, A., Hogg, D.: Learning flexible models from image sequences. In: Eklundh, J.-O. (ed.) ECCV 1994. LNCS, vol. 800, pp. 299–308. Springer, Heidelberg (1994)
Lee, L., Dalley, G., Tieu, K.: Learning pedestrian models for silhouette refinement. In: Proc. of ICCV, pp. 663–670 (2003)
Rathi, Y., Vaswani, N., Tannenbaum, A., Yezzi, A.: Particle filtering for geometric active contours with application to tracking moving and deforming objects. In: Proc. of CVPR, pp. 2–9 (2005)
Toyama, K., Blake, A.: Probabilistic tracking in a metric space. In: Proc. of ICCV, pp. 50–57 (2001)
Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–577 (2003)
Wang, J., Yagi, Y.: Integrating color and shape-texture features for adaptive real-time tracking. IEEE Trans. on Image Processing 17(2), 235–240 (2008)
Sloan Jr., K.R., Tanimoto, S.L.: Progressive refinement of raster images. IEEE Trans. on Computers 28(11), 871–874 (1979)
Marszalek, M., Schmid, C.: Accurate object localization with shape masks. In: Proc. of CVPR, pp. 1–8 (2007)
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)
Bray, M., Kohli, P., Torr, P.H.S.: Posecut: simultaneous segmentation and 3d pose estimation of humans using dynamic graph-cuts. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 642–655. Springer, Heidelberg (2006)
Sidenbladh, H., Black, M.J.: Learning the statistics of people in images and video. Int’l Journal of Computer Vision 54(3), 183–209 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, J., Yagi, Y., Makihara, Y. (2010). People Tracking and Segmentation Using Efficient Shape Sequences Matching. In: Zha, H., Taniguchi, Ri., Maybank, S. (eds) Computer Vision – ACCV 2009. ACCV 2009. Lecture Notes in Computer Science, vol 5995. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12304-7_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-12304-7_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12303-0
Online ISBN: 978-3-642-12304-7
eBook Packages: Computer ScienceComputer Science (R0)