[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Log in

Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera

  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract.

Omnidirectional cameras that give a 360° panoramic view of the surroundings have recently been used in many applications such as robotics, navigation, and surveillance. This paper describes the application of parametric ego-motion estimation for vehicle detection to perform surround analysis using an automobile-mounted camera. For this purpose, the parametric planar motion model is integrated with the transformations to compensate distortion in omnidirectional images. The framework is used to detect objects with independent motion or height above the road. Camera calibration as well as the approximate vehicle speed obtained from a CAN bus are integrated with the motion information from spatial and temporal gradients using a Bayesian approach. The approach is tested for various configurations of an automobile-mounted omni camera as well as a rectilinear camera. Successful detection and tracking of moving vehicles and generation of a surround map are demonstrated for application to intelligent driver support.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Achler O, Trivedi MM (2002) Real-time traffic flow analysis using omnidirectional video network and flatplane transformation. In: Workshop on intelligent transportation systems. Chicago

  2. Achler O, Trivedi MM (2004) Vehicle wheel detector using 2d filter banks. In: Proc. IEEE symposium on intelligent vehicles, pp 25-30

  3. Adiv G (1985) Determining three-dimensional motion and structure from optical flow generated by several moving objects. IEEE Trans Pattern Anal Mach Intell 7(4):384-401

    Google Scholar 

  4. Bar-Shalom Y, Li XR, Kirubarajan T (2001) Estimation with applications to tracking and navigation. Wiley, New York

  5. Benosman R, Kang SB (2001) Panoramic vision: sensors, theory, and applications. Springer, Berlin Heidelberg New York

    Google Scholar 

  6. Bertozzi M, Broggi A (1998) Gold: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans Image Proc 7(1):62-81

    Google Scholar 

  7. Black MJ, Anandan P (1996) The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Comput Vis Image Understand 63(1):75-104

    Google Scholar 

  8. Daniilidis K, Makadia A, Bulow T (2002) Image processing in catadioptric planes: spatiotemporal derivatives and optical flow computation. In: IEEE workshop on omnidirectional vision, pp 3-12

  9. Danuser G, Stricker M (1998) Parametric model fitting: from inlier characterization to outlier detection. IEEE Trans Pattern Anal Mach Intell 20(2):263-280

    Google Scholar 

  10. Enkelmann W (2001) Video-based driver assistance: from basic functions to applications. Int J Comput Vis 45(3):201-221

    Google Scholar 

  11. Faugeras O (1993) Three-dimensional computer vision: a geometric viewpoint. MIT Press, Cambridge, MA

  12. Forsyth D, Ponce J (2003) Computer vision: a modern approach. Prentice-Hall, Upper Saddle River, NJ

    Google Scholar 

  13. Gandhi T, Trivedi MM (2003) Motion analysis of omni-directional video streams for a mobile sentry. In: 1st ACM international workshop on video surveillance, pp 49-58, Berkeley, CA

  14. Gandhi T, Trivedi MM (2004) Motion based vehicle surround analysis using omni-directional camera. In: Proc. IEEE symposium intelligent vehicles, pp 560-565

  15. Gluckman J, Nayar S (1998) Ego-motion and omnidirectional cameras. In: Proc. international conference on computer vision, pp 999-1005

  16. Hicks RA, Bajcsy R (1999) Reflective surfaces as computational sensors. In: Proc. 2nd workshop on perception for mobile agents, pp 82-86

  17. Horn B, Schunck B (1981) Determining optical flow. In: DARPA81, pp 144-156

  18. Huang, K, Trivedi MM, Gandhi T (2003) Driver’s view and vehicle surround estimation using omnidirectional video stream. In: IEEE symposium intelligent vehicles, Columbus, OH, pp 444-449

  19. Huang KC, Trivedi MM (2003) Video arrays for real-time tracking of persons, head and face in an intelligent room. Mach Vis Appl 14(2):103-111

    Google Scholar 

  20. Irani M, Anandan P (1998) A unified approach to moving object detection in 2D and 3D scenes. IEEE Trans Pattern Anal Mach Intell 20(6):577-589

    Google Scholar 

  21. Irani M, Rousso B, Peleg S (1994) Computing occluding and transparent motions. Int J Comput Vis 12:5-16

    Google Scholar 

  22. Jähne B, Haußecker H, Geißler P (1999) Handbook of Computer Vision and Applications, vol 2, chap 14, pp 397-422. Academic Press, San Diego, CA

  23. Kruger W (1999) Robust real time ground plane motion compensation from a moving vehicle. Mach Vis Appl 11:203-212

    Google Scholar 

  24. Labayrade R, Aubert D, Tarel J-P (2002) Real time obstacle detection in stereovision on non flat road geometry through v-disparity representation. In: IEEE symposium intelligent vehicles, 2:646-651

  25. Lourakis MIA, Orphanoudakis SC (1998) Visual detection of obstacles assuming a locally planar ground. In: Asian conference on computer vision, 2:527-534

  26. Shakernia O, Vidal R, Sastry S (2003) Omnidirectional egomotion estimation from back-projection flow. In: IEEE workshop on omnidirectional vision

  27. Simoncelli EP (1993) Coarse-to-fine estimation of visual motion. In: Proc. 8th workshop on image and multidimensional signal processing, Cannes, France, pp 128-129

  28. Svoboda T, Pajdla T, Hlaváč V (1998) Motion estimation using central panoramic cameras. In: IEEE international conference on intelligent vehicles, pp 335-340

  29. Trucco E, Verri A (1998) Computer vision and applications: a guide for students and practitioners. Prentice Hall, Upper Saddle River, NJ

    Google Scholar 

  30. Vassallo RF, Santos-Victor J, Schneebeli HJ (2002) A general approach for egomotion estimation with omnidirectional images. In: IEEE workshop on omnidirectional vision, pp 97-103

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tarak Gandhi.

Additional information

Received: 1 August 2003, Accepted: 8 July 2004, Published online: 3 February 2005

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gandhi, T., Trivedi, M. Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera. Machine Vision and Applications 16, 85–95 (2005). https://doi.org/10.1007/s00138-004-0168-z

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-004-0168-z

Keywords:

Navigation