[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content

Advertisement

Springer Nature Link
Log in

Computer Vision Onboard UAVs for Civilian Tasks

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

Computer vision is much more than a technique to sense and recover environmental information from an UAV. It should play a main role regarding UAVs’ functionality because of the big amount of information that can be extracted, its possible uses and applications, and its natural connection to human driven tasks, taking into account that vision is our main interface to world understanding. Our current research’s focus lays on the development of techniques that allow UAVs to maneuver in spaces using visual information as their main input source. This task involves the creation of techniques that allow an UAV to maneuver towards features of interest whenever a GPS signal is not reliable or sufficient, e.g. when signal dropouts occur (which usually happens in urban areas, when flying through terrestrial urban canyons or when operating on remote planetary bodies), or when tracking or inspecting visual targets—including moving ones—without knowing their exact UMT coordinates. This paper also investigates visual servoing control techniques that use velocity and position of suitable image features to compute the references for flight control. This paper aims to give a global view of the main aspects related to the research field of computer vision for UAVs, clustered in four main active research lines: visual servoing and control, stereo-based visual navigation, image processing algorithms for detection and tracking, and visual SLAM. Finally, the results of applying these techniques in several applications are presented and discussed: this study will encompass power line inspection, mobile target tracking, stereo distance estimation, mapping and positioning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Puri, A., Valavanis, K.P., Kontitsis, M.: Statistical profile generation for traffic monitoring using real-time UAV based video data. In: Control and Automation, 2007. MED ’07. Mediterranean Conference on, MED, pp. 1–6 (2007)

  2. Nikolos, I.K., Tsourveloudis, N.C., Valavanis, K.P.: Evolutionary algorithm based path planning for multiple UAV cooperation. In: Advances in Unmanned Aerial Vehicles, Intelligent Systems, Control and Automation: Science and Engineering, pp. 309–340. Springer, The Netherlands (2007)

    Chapter  Google Scholar 

  3. Nikolos, I.K., Tsourveloudis, N.C., Valavanis, K.P.: A UAV vision system for airborne surveillance. In: Robotics and Automation, 2004. Proceedings. ICRA ’04. 2004 IEEE International Conference on, pp. 77–83. New Orleans, LA, USA (2004), May

  4. Nikolos, I.K., Tsourveloudis, N.C., Valavanis, K.P.: Multi-UAV experiments: application to forest fires. In: Multiple Heterogeneous Unmanned Aerial Vehicles, Springer Tracts in Advanced Robotics, pp. 207–228. Springer, Berlin (2007)

    Google Scholar 

  5. Green, W., Oh, P.Y.: The integration of a multimodal mav and biomimetic sensing for autonomous flights in near-earth environments. In: Advances in Unmanned Aerial Vehicles, Intelligent Systems, Control and Automation: Science and Engineering, pp. 407–430. Springer, The Netherlands (2007)

    Chapter  Google Scholar 

  6. Belloni, G., Feroli, M., Ficola, A., Pagnottelli, S., Valigi, P.: Obstacle and terrain avoidance for miniature aerial vehicles. In: Advances in Unmanned Aerial Vehicles, Intelligent Systems, Control and Automation: Science and Engineering, pp. 213–244. Springer, The Netherlands (2007)

    Google Scholar 

  7. Dalamagkidis, K., Valavanis, K.P., Piegl, L.A.: Current status and future perspectives for unmanned aircraft system operations in the US. In: Journal of Intelligent and Robotic Systems, pp. 313–329. Springer, The Netherlands (2007)

    Google Scholar 

  8. Long, L.N., Corfeld, K.J., Strawn, R.C.: Computational analysis of a prototype martian rotorcraft experiment. In: 20th AIAA Applied Aerodynamics Conference, number AIAA Paper 2002–2815, Saint Louis, MO, USA. Ames Research Center, June–October 22 (2001)

  9. Yavrucuk, I., Kanan, S., Kahn, A.D.: Gtmars—flight controls and computer architecture. Technical report, School of Aerospace Engineering, Georgia Institute of Technology, Atlanta (2000)

  10. Buenaposada, J.M., Munoz, E., Baumela, L.: Tracking a planar patch by additive image registration. In: Proc. of International Workshop, VLBV 2003, vol. 2849 of LNCS, pp. 50–57 (2003)

  11. Miller, R., Mettler, B., Amidi, O.: Carnegie mellon university’s 1997 international aerial robotics competition entry. In: International Aerial Robotics Competition (1997)

  12. Montgomery, J.F.: The usc autonomous flying vehicle (afv) project: Year 2000 status. Technical Report IRIS-00-390, Institute for Robotics and Intelligent Systems Technical Report, Los Angeles, CA, 90089-0273 (2000)

  13. Saripalli, S., Montgomery, J.F., Sukhatme, G.S.: Visually-guided landing of an unmanned aerial vehicle. IEEE Trans. Robot Autom. 19(3), 371–381, June (2003)

    Article  Google Scholar 

  14. Mejias, L.: Control visual de un vehiculo aereo autonomo usando detección y seguimiento de características en espacios exteriores. PhD thesis, Escuela Técnica Superior de Ingenieros Industriales. Universidad Politécnica de Madrid, Spain, December (2006)

  15. Mejias, L., Saripalli, S., Campoy, P., Sukhatme, G.: Visual servoing approach for tracking features in urban areas using an autonomous helicopter. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 2503–2508, Orlando, FL, May (2006)

  16. Mejias, L., Saripalli, S., Sukhatme, G., Campoy, P.: Detection and tracking of external features in a urban environment using an autonomous helicopter. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 3983–3988, May (2005)

  17. Mejias, L., Saripalli, S., Campoy, P., Sukhatme, G.: Visual servoing of an autonomous helicopter in urban areas using feature tracking. J. Field Robot. 23(3–4), 185–199, April (2006)

    Article  Google Scholar 

  18. Harris, C.G., Stephens, M.: A combined corner and edge detection. In: Proceedings of the 4th Alvey Vision Conference, pp. 147–151 (1988)

  19. Lowe, D.G.: Distintive image features from scale-invariant keypoints. Int. J. Computer Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  20. Duda, R.O., Hart, P.E.: Use of the hough transformation to detect lines and curves in pictures. Commun. ACM 15(1), 11–15 (1972)

    Article  Google Scholar 

  21. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Machine Intel. 8(6), 679–698, November (1986)

    Article  Google Scholar 

  22. Feldman, G., Sobel, I.: A 3 × 3 isotropic gradient operator for image processing. Presented at a talk at the Stanford Artificial Project (1968)

  23. Mejías, L., Mondragón, I., Correa, J.F., Campoy, P.: Colibri: Vision-guided helicopter for surveillance and visual inspection. In: Video Proceedings of IEEE International Conference on Robotics and Automation, Rome, Italy, April (2007)

  24. Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. of the 7th IJCAI, pp. 674–679, Vancouver, Canada (1981)

  25. Beis, J.S., Lowe, D.G.: Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: CVPR ’97: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR ’97), p. 1000. IEEE Computer Society, Washington, DC, USA (1997)

    Chapter  Google Scholar 

  26. Fischer, M.A., Bolles, R.C.: Random sample concensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  Google Scholar 

  27. Baker, S., Matthews, I.: Lucas-kanade 20 years on: A unifying framework: Part 1. Technical Report CMU-RI-TR-02-16, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, July (2002)

  28. Mejias, L., Campoy, P., Mondragon, I., Doherty, P.: Stereo visual system for autonomous air vehicle navigation. In: 6th IFAC Symposium on Intelligent Autonomous Vehicles (IAV 07), Toulouse, France, September (2007)

  29. Martin, J., Crowley, J.: Experimental comparison of correlation techniques. Technical report, IMAG-LIFIA, 46 Av. Félix Viallet 38031 Grenoble, France (1995)

  30. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Proceedings of the Ninth European Conference on Computer Vision, May (2006)

  31. Montiel, J.M.M., Civera, J., Davison, A.J.: Unified inverse depth parametrization for monocular slam. In: Robotics: Science and Systems (2006)

  32. Civera, J., Davison, A.J., Montiel, J.M.M.: Dimensionless monocular slam. In: IbPRIA, pp. 412–419 (2007)

  33. COLIBRI. Universidad Politécnica de Madrid. Computer Vision Group. COLIBRI Project. http://www.disam.upm.es/colibri (2005)

Download references

Author information

Authors and Affiliations

  1. Computer Vision Group, Universidad Politécnica Madrid, Jose Gutierrez Abascal 2, 28006, Madrid, Spain

    Pascual Campoy, Juan F. Correa, Ivan Mondragón, Carol Martínez, Miguel Olivares & Jorge Artieda

  2. Australian Research Centre for Aerospace Automation (ARCAA), School of Engineering Systems, Queensland University of Technology, GPO Box 2434, Brisbane, 4000, Australia

    Luis Mejías

Authors
  1. Pascual Campoy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juan F. Correa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ivan Mondragón
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carol Martínez
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Miguel Olivares
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Luis Mejías
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jorge Artieda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pascual Campoy.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Campoy, P., Correa, J.F., Mondragón, I. et al. Computer Vision Onboard UAVs for Civilian Tasks. J Intell Robot Syst 54, 105–135 (2009). https://doi.org/10.1007/s10846-008-9256-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-008-9256-z

Keywords

Search

Navigation