[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Log in

Partial Linear Gaussian Models for Tracking in Image Sequences Using Sequential Monte Carlo Methods

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

An Erratum to this article was published on 08 July 2008

Abstract

The recent development of Sequential Monte Carlo methods (also called particle filters) has enabled the definition of efficient algorithms for tracking applications in image sequences. The efficiency of these approaches depends on the quality of the state-space exploration, which may be inefficient due to a crude choice of the function used to sample in the associated probability space. A careful study of this issue led us to consider the modeling of the tracked dynamic system with partial linear Gaussian models. Such models are characterized by a non linear dynamic equation, a linear measurement equation and additive Gaussian noises. They allow inferring an analytic expression of the optimal importance function used in the diffusion process of the particle filter, and enable building a relevant approximation of a validation gate. Despite of these potential advantages partial linear Gaussian models have not been investigated. The aim of this paper is therefore to demonstrate that such models can be of real interest facing difficult usual issues such as occlusions, ambiguities due to cluttered backgrounds and large state space. Three instances of these models are proposed. After a theoretical analysis, their significance is demonstrated by their performance for tracking points and planar objects in challenging real-world image sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Anderson, B.D.O. and Moore, J.B. 1979. Optimal Filtering. Prentice Hall, Englewood Cliffs, NJ.

    MATH  Google Scholar 

  • Arnaud, E. and Mémin, E. 2004. Optimal importance sampling for tracking in image sequences: application to point tracking. In European Conference on Computer Vision, Vol. 3, pp. 302–314.

    Google Scholar 

  • Arnaud, E., Mémin, E., and Cernuschi-Frías, B. 2005. Conditional filters for image sequence based tracking—application to point tracking. IEEE Transactions of Image Processing, 14(1):63–79.

    Article  Google Scholar 

  • Arulampalam, M.S., Maskell, S., Gordon, N., and Clapp, T. 2002. A tutorial on particles filters for online Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50(2):174–18.

    Article  Google Scholar 

  • Aschwanden, P. and Guggenbül, W. 1992. Experimental results from a comparative study on correlation type registration algorithms. In Robust Computer Vision: Quality of Vision Algorithms, Förstner and Ruwiedel, (Ed.), Wichmann, pp. 268–282.

  • Bar-Shalom, Y. and Li, X.-R. 1995. Multitarget-Multisensor Tracking: Principles and Techniques. Artech House Publishers.

  • Bilmes, J. 1997. A gentle tutorial on the em algorithm and its application to parameter estimation for gaussian mixture and hidden markov models. Technical report, University of Berkeley.

  • Black, M. and Anandan, P. 1996. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding, 63(1):75–104.

    Article  Google Scholar 

  • Black, M. and Fleet, D. 1999. Probabilistic detection and tracking of motion discontinuities. In International Conference on Computer Vision, Vol. 2, pp. 551–558.

    Article  Google Scholar 

  • Blake, A., North, B., and Isard, M. 1999. Learning multi-class dynamics. Advances in Neural Information Processing Systems, 11:389–395.

    Google Scholar 

  • Brand, M. 2001. Morphable 3d models from video. In Conference on Computer Vision and Pattern Recognition.

  • Breidt, F.J. and Carriquiry, A.L. 2000. Highest density gates for target tracking. IEEE Transactions on Aerospace and Electronic Systems, 36:46–55.

    Article  Google Scholar 

  • Casella, G. and Robert, C. 1996. Rao-Blackwelisation of sampling schemes. Biometrika, 83(1):81–94.

    Article  MathSciNet  MATH  Google Scholar 

  • Chen, R. and Liu, J.S. 2000. Mixture Kalman filters. Journal of the Royal Statistical Society, Serie B, 62(3):493–508.

    Article  MATH  Google Scholar 

  • Comaniciu, D., Ramesh, V., and Meer, P. 2003. Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5):564–574.

    Article  Google Scholar 

  • Cuzol, A. and Mémin, E. 2005. A stochastic filter for fluid motion tracking. In International Conference on Computer Vision.

  • Doucet, A., de Freitas, N., and Gordon, N. (Eds.) 2001. Sequential Monte Carlo Methods in Practice. Springer-Verlag, New York. Series Statistics for Engineering and Information Science.

  • Doucet, A., de Freitas, N., Murphy, K., and Russell, S. 2000. Rao-Blackwellised particle filtering for dynamic Bayesian networks. In Conference on Uncertaincy in Artificial Intelligence.

  • Doucet, A., Godsill, S., and Andrieu, C. 2000. On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing, 10(3):197–208.

    Article  Google Scholar 

  • Faugeras, O. and Lustman, F. 1988. Motion and structure from motion in a piecewise planar environment. Technical report, INRIA, Institut National de Recherche en Informatique et Automatique.

  • Godsill, S. and Clapp, T. 2001. Improvement strategies for Monte Carlo particle filters. In Doucet01, chapter 7. Springer-Verlag.

  • Gordon, N. 1997. A hybrid Bootstrap filter for target tracking in clutter. IEEE Transactions in Aerospace and Electronic Systems, 33(1):353–358.

    Article  Google Scholar 

  • Gordon, N., Salmond, D., and Smith, A. 1993. Novel approach to Gaussian Bayesian state estimation. IEEE Proceedings-F, 140(2):107–113.

    Google Scholar 

  • Gustafsson, F., Gunnarsson, F., Bergman, N., Forssell, U., Jansson, J., Karlsson, R., and Nordlund, P.-J. 2002. Particle filters for positioning, navigation and tracking. IEEE Transactions on Signal Processing, 50(2):425–437.

    Article  Google Scholar 

  • Harris, C. and Stephens, M. 1988. A combined corner and edge detector. In Proceedings of the Alvey Vision Conference, pp. 147–151.

  • Hinkley, D. 1971. Inference about the change-point from cumulative sum tests. Biometrika, 58(509–523).

    Article  MathSciNet  MATH  Google Scholar 

  • Isard, M. and Blake, A. 1998. Condensation—conditional density propagation for visual tracking. International Journal of Computer Vision, 29(1):5–28.

    Article  Google Scholar 

  • Isard, M. and Blake, A. 1998. A mixed-state condensation tracker with automatic model-switching. In International Conference on Computer Vision, pp. 107–112.

  • Jepson, A., Fleet, D., and El-Maraghi, T. 2001. Robust online appearance models for visual tracking. In Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 415–422.

    Google Scholar 

  • Khan, Z., Balch, T., and Dellaert, F. 2004. A Rao-Blackwellized particle filter for eigentracking. In Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 980–986.

    Google Scholar 

  • Kong, A., Liu, J.S., and Wong, W.H. 1994. Sequential imputations and Bayesian missing data problems. Journal of the American Statistical Association, 89:278–288.

    Article  MATH  Google Scholar 

  • Kwok, C., Fox, D., and Meilă, M. 2004. Real-time particle filter. Proceedings of the IEEE (issue on State Estimation) 92(2).

  • Liu, J.S. and Chen, R. 1998. Sequential Monte Carlo methods for dynamic systems. Journal of the American Statistical Association, 93:1032–1044.

    Article  MathSciNet  MATH  Google Scholar 

  • Ma, B. and Ellis, R.E. 2004. Surface-based registration with a particle filter. In Procedings of Medical Image Computing and Computer-Assisted Intervention.

  • Marrs, A., Maskell, S., and Bar-Shalom, Y. 2002. Expected likelihood for tracking in clutter with particle filters. In SPIE Conference on Signal and Data Processing of Small Targets.

  • Musso, C., Oudjane, N., and Le Gland, F. 2001. Improving regularised particle filters. In Doucet01, chapter 12. Springer-Verlag.

  • Nguyen, H.T., Worring, M., and van den Boomgaard, R. 2001. Occlusion robust adaptative template tracking. In International Conference on Computer Vision, Vol. 1, pp. 678–683.

    Google Scholar 

  • North, B. and Blake, A. 1998. Learning dynamical models using Expectation-Maximisation. In International Conference on Computer Vision.

  • Odobez, J.-M. and Bouthemy, P. 1995. Robust multiresolution estimation of parametric motion models. Journal of Visual Communication and Image Representation, 6(4):348–365.

    Article  Google Scholar 

  • Okuma, K., Taleghani, A., De Freitas, N., Little, J., and Lowe, D. 2004. A boosted particle filter: multitarget detection and tracking. In European Conference on Computer Vision.

  • Pitt, M. and Shephard, M. 2001. Auxiliary variable based particle filters. In Doucet01, chapter 13. Springer-Verlag.

  • Pérez, P., Hue, C., and Gangnet, M. 2002. Color-based probabilistic tracking. In European Conference on Computer Vision, pp. 661–675.

  • Pérez, P., Vermaak, J., and Blake, A. 2004. Data fusion for visual tracking with particles. In Proceedings of the IEEE (Issue on State Estimation), 92(3):495–513.

    Google Scholar 

  • Rittscher, J. and Blake, A. 1999. Classification of human body motion. In International Conference on Computer Vision, pp. 634–639.

  • Rui, Y. and Chen, Y. 2001. Better proposal distributions: object tracking using unscented particle filter. In Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 786–793.

    Google Scholar 

  • Shi, J. and Tomasi, C. 1994. Good features to track. In Conference on Computer Vision and Pattern Recognition, pp. 593–600.

  • Sidenbladh, H., Black, M., and Sigal, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In European Conference on Computer Vision, Vol. 1, pp. 784–800.

    Google Scholar 

  • Sivic, J., Schaffalizky, F., and Zisserman, A. 2004. Object lovel grouping for video shots. In European Conference on Computer Vision, pp. 85–98.

  • Sminchisescu, C. and Triggs, B. 2002. Hyperdynamic importance sampling. In European Conference on Computer Vision.

  • Sullivan, J. and Rittscher, J. 2001. Guiding random particles by deterministic search. In International Conference on Computer Vision, pp. 323–330.

  • Tissainayagam, P. and Suter, D. 2004. Assessing the performance of corner detectors for point feature tracking applications. Image and Vision Computing, 22(8):663–679.

    Article  Google Scholar 

  • Torresani, L. and Bregler, C. 2002. Space-time tracking. In European Conference on Computer Vision.

  • van der Merwe, R., Doucet, A., de Freitas, N., and Wan, E. 2000. The unscented particle filter. Technical report cued/f-infeng/tr 380, University of Cambridge, Engineering Department.

  • Vermaak, J., Andrieu, C., Doucet, A., and Godsill, S.J. 2002. Particle methods for Bayesian modeling and enhancement of speech signals. IEEE Transactions on Speech and Audio Processing, 10(3):173–185.

    Article  Google Scholar 

  • Vermaak, J., Godsill, S.J., and Pérez, P. 2005. Monte Carlo filtering for multi-target tracking and data association. IEEE Transations on Aerospace and Electronic Systems 41(1):309–332.

    Article  Google Scholar 

  • Vermaak, J., Pérez, P., Gangnet, M., and Blake, A. 2002. Towards improved observation models for visual tracking: selective adaptation. In European Conference on Computer Vision, Vol. 1, pp. 645–660.

    Google Scholar 

  • Wan, E.A. and van der Merwe, R. 2000. The unscented kalman filter for nonlinear estimation. In IEEE Symposium on Adaptive Systems for Signal Processing, Communication and Control.

  • Wu, Y. and Huang, T. 2004. Robust vision tracking by integrating multiple cues based on co-inference learning. International Journal of Computer Vision, 58(1):55–71.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elise Arnaud.

Additional information

An erratum to this article can be found at http://dx.doi.org/10.1007/s11263-008-0150-8

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arnaud, E., Mémin, E. Partial Linear Gaussian Models for Tracking in Image Sequences Using Sequential Monte Carlo Methods. Int J Comput Vision 74, 75–102 (2007). https://doi.org/10.1007/s11263-006-0003-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-0003-2

Keywords

Navigation