Abstract
We present a nonparametric background subtraction method that uses the local spatial co-occurrence correlations between neighboring pixels to robustly and efficiently detect moving objects in dynamic scenes. We first represent each pixel as a joint feature vector consisting of its spatial coordinates and appearance properties (e.g., intensities, color, edges, or gradients). This joint feature vector naturally fuses spatial and appearance features to simultaneously consider meaningful correlation between neighboring pixels and pixels’ appearance changes, which are very important for dynamic background modeling. Then, each pixel’s background model is modeled via an adaptive binned kernel estimation, which is updated by the neighboring pixels’ feature vectors in a local rectangle region around the pixel. The adaptive binned kernel estimation is adopted due to it is computationally inexpensive and does not need any assumptions about the underlying distributions. Qualitative and quantitative experimental results on challenging video sequences demonstrate the robustness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: Real-Time Tracking of the Human Body. TPAMI 19(7), 780–785 (1997)
Stauffer, C., Grimson, W.E.L.: Learning Patterns of Activity Using Real-Time Tracking. TPAMI 22(8), 747–757 (2000)
Javed, O., Shafique, K., Shah, M.: A Hierarchical Approach to Robust Background Subtraction using Color and Gradient Information. In: IEEE Workshop on Motion and Video Computing, pp. 22–27 (2002)
Bouwmans, T., El Baf, F., Vachon, B.: Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey. Recent Patents on Computer Science 1(3), 219–237 (2008)
Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: Principles and Practice of Background Maintenance. In: ICCV, vol. 1, pp. 255–261 (1999)
Monnet, A., Mittal, A., Paragios, N., Visvanathan, R.: Background Modeling and Subtraction of Dynamic Scenes. In: ICCV, vol. 2, pp. 1305–1312 (2003)
Kato, J., Watanabe, T., Joga, S., Rittscher, J., Blake, A.: An HMM-Based Segmentation Method for Traffic Monitoring Movies. TPAMI 24(9), 1291–1296 (2002)
Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Real-time Surveillance of People and Their Activities. TPAMI 22(8), 809–830 (2000)
Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time Foreground-Background Segmentation using Codebook Model. Real-Time Imaging 11(3), 167–256 (2005)
Heikkila, M., Pietikainen, M.: A Texture-Based Method for Modeling the Background and Detecting Moving Objects. TPAMI 28(4), 657–662 (2006)
Patwardhan, K.A., Sapiro, G., Morellas, V.: Robust Foreground Detection in Video Using Pixel Layers. TPAMI 30(4), 746–751 (2008)
Elgammal, A., Harwood, D., Davis, L.: Non-parametric Model for Background Subtraction. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 751–767. Springer, Heidelberg (2000)
Sheikh, Y., Shah, M.: Bayesian Modeling of Dynamic Scenes for Object Detection. TPAMI 27(11), 1778–1792 (2005)
Mittal, A., Paragios, N.: Motion-based Background Subtraction using Adaptive Kernel Density Estimation. In: CVPR, July 2004, vol. 2, pp. 302–309 (2004)
Parag, T., Elgammal, A., Mittal, A.: A Framework for Feature Selection for Background Subtraction. In: CVPR, vol. 2, pp. 1916–1923 (2006)
Elgammal, A.M., Duraiswami, R., Davis, L.S.: Efficient Kernel Density Estimation Using the Fast Gauss Transform with Applications to Color Modeling and Tracking. TPAMI 25(11), 1499–1504 (2003)
Hall, P., Wand, M.: On the Accuracy of Binned Kernel Estimators. J. Multivariate Analysis (1995)
Sain, S.: Multivariate Locally Adaptive Density Estimates. Computational Statistics and Data Analysis (2002)
Li, L., Huang, W., Gu, I.Y.H., Tian, Q.: Statistical Modeling of Complex Backgrounds for Foreground Object Detection. TIP 13(11), 1459–1472 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhong, B., Liu, S., Yao, H. (2010). Local Spatial Co-occurrence for Background Subtraction via Adaptive Binned Kernel Estimation. In: Zha, H., Taniguchi, Ri., Maybank, S. (eds) Computer Vision – ACCV 2009. ACCV 2009. Lecture Notes in Computer Science, vol 5996. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12297-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-12297-2_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12296-5
Online ISBN: 978-3-642-12297-2
eBook Packages: Computer ScienceComputer Science (R0)