Abstract
The recent development of Sequential Monte Carlo methods (also called particle filters) has enabled the definition of efficient algorithms for tracking applications in image sequences. The efficiency of these approaches depends on the quality of the state-space exploration, which may be inefficient due to a crude choice of the function used to sample in the associated probability space. A careful study of this issue led us to consider the modeling of the tracked dynamic system with partial linear Gaussian models. Such models are characterized by a non linear dynamic equation, a linear measurement equation and additive Gaussian noises. They allow inferring an analytic expression of the optimal importance function used in the diffusion process of the particle filter, and enable building a relevant approximation of a validation gate. Despite of these potential advantages partial linear Gaussian models have not been investigated. The aim of this paper is therefore to demonstrate that such models can be of real interest facing difficult usual issues such as occlusions, ambiguities due to cluttered backgrounds and large state space. Three instances of these models are proposed. After a theoretical analysis, their significance is demonstrated by their performance for tracking points and planar objects in challenging real-world image sequences.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Anderson, B.D.O. and Moore, J.B. 1979. Optimal Filtering. Prentice Hall, Englewood Cliffs, NJ.
Arnaud, E. and Mémin, E. 2004. Optimal importance sampling for tracking in image sequences: application to point tracking. In European Conference on Computer Vision, Vol. 3, pp. 302–314.
Arnaud, E., Mémin, E., and Cernuschi-Frías, B. 2005. Conditional filters for image sequence based tracking—application to point tracking. IEEE Transactions of Image Processing, 14(1):63–79.
Arulampalam, M.S., Maskell, S., Gordon, N., and Clapp, T. 2002. A tutorial on particles filters for online Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50(2):174–18.
Aschwanden, P. and Guggenbül, W. 1992. Experimental results from a comparative study on correlation type registration algorithms. In Robust Computer Vision: Quality of Vision Algorithms, Förstner and Ruwiedel, (Ed.), Wichmann, pp. 268–282.
Bar-Shalom, Y. and Li, X.-R. 1995. Multitarget-Multisensor Tracking: Principles and Techniques. Artech House Publishers.
Bilmes, J. 1997. A gentle tutorial on the em algorithm and its application to parameter estimation for gaussian mixture and hidden markov models. Technical report, University of Berkeley.
Black, M. and Anandan, P. 1996. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding, 63(1):75–104.
Black, M. and Fleet, D. 1999. Probabilistic detection and tracking of motion discontinuities. In International Conference on Computer Vision, Vol. 2, pp. 551–558.
Blake, A., North, B., and Isard, M. 1999. Learning multi-class dynamics. Advances in Neural Information Processing Systems, 11:389–395.
Brand, M. 2001. Morphable 3d models from video. In Conference on Computer Vision and Pattern Recognition.
Breidt, F.J. and Carriquiry, A.L. 2000. Highest density gates for target tracking. IEEE Transactions on Aerospace and Electronic Systems, 36:46–55.
Casella, G. and Robert, C. 1996. Rao-Blackwelisation of sampling schemes. Biometrika, 83(1):81–94.
Chen, R. and Liu, J.S. 2000. Mixture Kalman filters. Journal of the Royal Statistical Society, Serie B, 62(3):493–508.
Comaniciu, D., Ramesh, V., and Meer, P. 2003. Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5):564–574.
Cuzol, A. and Mémin, E. 2005. A stochastic filter for fluid motion tracking. In International Conference on Computer Vision.
Doucet, A., de Freitas, N., and Gordon, N. (Eds.) 2001. Sequential Monte Carlo Methods in Practice. Springer-Verlag, New York. Series Statistics for Engineering and Information Science.
Doucet, A., de Freitas, N., Murphy, K., and Russell, S. 2000. Rao-Blackwellised particle filtering for dynamic Bayesian networks. In Conference on Uncertaincy in Artificial Intelligence.
Doucet, A., Godsill, S., and Andrieu, C. 2000. On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing, 10(3):197–208.
Faugeras, O. and Lustman, F. 1988. Motion and structure from motion in a piecewise planar environment. Technical report, INRIA, Institut National de Recherche en Informatique et Automatique.
Godsill, S. and Clapp, T. 2001. Improvement strategies for Monte Carlo particle filters. In Doucet01, chapter 7. Springer-Verlag.
Gordon, N. 1997. A hybrid Bootstrap filter for target tracking in clutter. IEEE Transactions in Aerospace and Electronic Systems, 33(1):353–358.
Gordon, N., Salmond, D., and Smith, A. 1993. Novel approach to Gaussian Bayesian state estimation. IEEE Proceedings-F, 140(2):107–113.
Gustafsson, F., Gunnarsson, F., Bergman, N., Forssell, U., Jansson, J., Karlsson, R., and Nordlund, P.-J. 2002. Particle filters for positioning, navigation and tracking. IEEE Transactions on Signal Processing, 50(2):425–437.
Harris, C. and Stephens, M. 1988. A combined corner and edge detector. In Proceedings of the Alvey Vision Conference, pp. 147–151.
Hinkley, D. 1971. Inference about the change-point from cumulative sum tests. Biometrika, 58(509–523).
Isard, M. and Blake, A. 1998. Condensation—conditional density propagation for visual tracking. International Journal of Computer Vision, 29(1):5–28.
Isard, M. and Blake, A. 1998. A mixed-state condensation tracker with automatic model-switching. In International Conference on Computer Vision, pp. 107–112.
Jepson, A., Fleet, D., and El-Maraghi, T. 2001. Robust online appearance models for visual tracking. In Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 415–422.
Khan, Z., Balch, T., and Dellaert, F. 2004. A Rao-Blackwellized particle filter for eigentracking. In Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 980–986.
Kong, A., Liu, J.S., and Wong, W.H. 1994. Sequential imputations and Bayesian missing data problems. Journal of the American Statistical Association, 89:278–288.
Kwok, C., Fox, D., and Meilă, M. 2004. Real-time particle filter. Proceedings of the IEEE (issue on State Estimation) 92(2).
Liu, J.S. and Chen, R. 1998. Sequential Monte Carlo methods for dynamic systems. Journal of the American Statistical Association, 93:1032–1044.
Ma, B. and Ellis, R.E. 2004. Surface-based registration with a particle filter. In Procedings of Medical Image Computing and Computer-Assisted Intervention.
Marrs, A., Maskell, S., and Bar-Shalom, Y. 2002. Expected likelihood for tracking in clutter with particle filters. In SPIE Conference on Signal and Data Processing of Small Targets.
Musso, C., Oudjane, N., and Le Gland, F. 2001. Improving regularised particle filters. In Doucet01, chapter 12. Springer-Verlag.
Nguyen, H.T., Worring, M., and van den Boomgaard, R. 2001. Occlusion robust adaptative template tracking. In International Conference on Computer Vision, Vol. 1, pp. 678–683.
North, B. and Blake, A. 1998. Learning dynamical models using Expectation-Maximisation. In International Conference on Computer Vision.
Odobez, J.-M. and Bouthemy, P. 1995. Robust multiresolution estimation of parametric motion models. Journal of Visual Communication and Image Representation, 6(4):348–365.
Okuma, K., Taleghani, A., De Freitas, N., Little, J., and Lowe, D. 2004. A boosted particle filter: multitarget detection and tracking. In European Conference on Computer Vision.
Pitt, M. and Shephard, M. 2001. Auxiliary variable based particle filters. In Doucet01, chapter 13. Springer-Verlag.
Pérez, P., Hue, C., and Gangnet, M. 2002. Color-based probabilistic tracking. In European Conference on Computer Vision, pp. 661–675.
Pérez, P., Vermaak, J., and Blake, A. 2004. Data fusion for visual tracking with particles. In Proceedings of the IEEE (Issue on State Estimation), 92(3):495–513.
Rittscher, J. and Blake, A. 1999. Classification of human body motion. In International Conference on Computer Vision, pp. 634–639.
Rui, Y. and Chen, Y. 2001. Better proposal distributions: object tracking using unscented particle filter. In Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 786–793.
Shi, J. and Tomasi, C. 1994. Good features to track. In Conference on Computer Vision and Pattern Recognition, pp. 593–600.
Sidenbladh, H., Black, M., and Sigal, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In European Conference on Computer Vision, Vol. 1, pp. 784–800.
Sivic, J., Schaffalizky, F., and Zisserman, A. 2004. Object lovel grouping for video shots. In European Conference on Computer Vision, pp. 85–98.
Sminchisescu, C. and Triggs, B. 2002. Hyperdynamic importance sampling. In European Conference on Computer Vision.
Sullivan, J. and Rittscher, J. 2001. Guiding random particles by deterministic search. In International Conference on Computer Vision, pp. 323–330.
Tissainayagam, P. and Suter, D. 2004. Assessing the performance of corner detectors for point feature tracking applications. Image and Vision Computing, 22(8):663–679.
Torresani, L. and Bregler, C. 2002. Space-time tracking. In European Conference on Computer Vision.
van der Merwe, R., Doucet, A., de Freitas, N., and Wan, E. 2000. The unscented particle filter. Technical report cued/f-infeng/tr 380, University of Cambridge, Engineering Department.
Vermaak, J., Andrieu, C., Doucet, A., and Godsill, S.J. 2002. Particle methods for Bayesian modeling and enhancement of speech signals. IEEE Transactions on Speech and Audio Processing, 10(3):173–185.
Vermaak, J., Godsill, S.J., and Pérez, P. 2005. Monte Carlo filtering for multi-target tracking and data association. IEEE Transations on Aerospace and Electronic Systems 41(1):309–332.
Vermaak, J., Pérez, P., Gangnet, M., and Blake, A. 2002. Towards improved observation models for visual tracking: selective adaptation. In European Conference on Computer Vision, Vol. 1, pp. 645–660.
Wan, E.A. and van der Merwe, R. 2000. The unscented kalman filter for nonlinear estimation. In IEEE Symposium on Adaptive Systems for Signal Processing, Communication and Control.
Wu, Y. and Huang, T. 2004. Robust vision tracking by integrating multiple cues based on co-inference learning. International Journal of Computer Vision, 58(1):55–71.
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article can be found at http://dx.doi.org/10.1007/s11263-008-0150-8
Rights and permissions
About this article
Cite this article
Arnaud, E., Mémin, E. Partial Linear Gaussian Models for Tracking in Image Sequences Using Sequential Monte Carlo Methods. Int J Comput Vision 74, 75–102 (2007). https://doi.org/10.1007/s11263-006-0003-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-006-0003-2