Integrated Hybrid Planning and Programmed Control for Real Time UAV Maneuvering
Authors: 
Miquel Ramirez, Michael Papasimeon, Nir Lipovetzky, Lyndon Benke, Tim Miller, Adrian R. Pearce, Enrico Scala, Mohammad ZamaniAuthors Info & Claims
Pages 1318 - 1326
Abstract
The automatic generation of realistic behaviour such as tactical intercepts for Unmanned Aerial Vehicles (UAV) in air combat is a challenging problem. State-of-the-art solutions propose hand--crafted algorithms and heuristics whose performance depends heavily on the initial conditions and aerodynamic properties of the UAVs involved. This paper shows how to employ domain--independent planners, embedded into professional multi--agent simulations, to implement two--level Model Predictive Control (MPC) hybrid control systems for simulated UAVs. We compare the performance of controllers using planners with others based on behaviour trees that implement real world tactics. Our results indicate that hybrid planners derive novel and effective tactics from first principles inherent to the dynamical constraints UAVs are subject to.
References
[1]
Fred Austin, Giro Carbone, Michael Falco, and Hans Hinz. 1990. Game Theory for Automated Maneuvering During Air-to-Air Combat. Journal of Guidance, Control and Dynamics 13, 6 (1990), 1143--1149.
[2]
Andy G. Barto, S. J. Bradtke, and S. P. Singh. 1995. Real Time Learning and Control Using Asynchronous Dynamic Programming. Artiicial Intelligence Journal 72 (1995), 81--138.
[3]
Alberto Bemporad, Manfred Morari, Vivek Dua, and Efstratios N Pistikopoulos. 2002. The explicit linear quadratic regulator for constrained systems. Automatica 38, 1 (2002), 3--20.
[4]
Dmitri P. Bertsekas. 2017. Dynamic Programming and Optimal Control (4th ed.). Athena Scientiic.
[5]
Francesco Borrelli, Alberto Bemporad, and Manfred Morari. 2017. Predictive control for linear and hybrid systems. Cambridge University Press.
[6]
John C. Butcher. 2008. Numerical Methods or Ordinary Diferential Equations (2nd ed.). Wiley & Sons.
[7]
Michael W. Byrnes. 2014. Nightfall: Machine Autonomy in Air-to-Air Combat. Air and Space Power Journal (May-June 2014).
[8]
Stefano Di Cairano. 2012. An industry perspective on MPC in large volumes applications: Potential Beneits and Open Challenges. IFAC Proceedings Volumes 45, 17 (2012), 52-59.
[9]
Eduardo F. Camacho and Carlos Bordons. 2013. Model predictive control (3rd ed.). Springer Science & Business Media.
[10]
Michele Colledanchise and Petter Ögren. 2017. How Behavior Trees Modularize Hybrid Control Systems and Generalize Sequential Behavior Compositions, the Subsumption Architecture, and Decision Trees. IEEE Transactions on Robotics 33, 2 (April 2017), 372-389.
[11]
Giuseppe DellaPenna, Daniele Magazzeni, Fabio Mercorio, and Benedetto Intrigila. 2009. UPMurphi: a tool for universal planning on PDDL+ problems. In Proc. of the Int'l Conf. in Automated Planning and Scheduling (ICAPS).
[12]
Rick Evertsz, John Thangarajah, Nitin Yadav, and Thanh Ly. 2015. A Framework for Modelling Tactical Decision-making in Autonomous Systems. J. Syst. Softw. 110, C (Dec. 2015), 222-238.
[13]
Maria Fox and Derek Long. 2003. PDDL2.1: An extension to PDDL for expressing temporal planning domains. Journal of Artiicial Intelligence Research 20 (2003), 61--124.
[14]
Maria Fox and Derek Long. 2006. Modelling Mixed Discrete-Continous Domains for Planning. Journal of Artiicial Intelligence Research 27 (2006), 235--297.
[15]
Guillem Frances and Hector Gefner. 2016.: Existential Quantiication in Planning and Constraint Satisfaction. In Proc. of Int'l Joint Conf. in Artiicial Intelligence (IJCAI).
[16]
Guillem Francès, Miquel Ramirez, Nir Lipovetzky, and Hector Gefner. 2017. Purely Declarative Action Descriptions are Overrated: Classical Planning with Simulators. In Proc. of Int'l Joint Conf. in Artiicial Intelligence (IJCAI).
[17]
Héctor Gefner. 2000. Functional STRIPS: a more lexible language for planning and problem solving. In Logic-based artiicial intelligence, Jack Minker (Ed.). Springer, 187--209.
[18]
Tomás Gefner and Hector Gefner. 2015. Width-based Planning for General Video-Game Playing. In AAAI Conference on Artiicial Intelligence and Interactive Digital Entertainment.
[19]
Malik Ghallab, Dana Nau, and Paolo Traverso. 2004. Automated Planning: theory and practice. Elsevier.
[20]
Rafal Goebel, Ricardo G. Sanfelice, and Andrew R. Teel. 2009. Hybrid Dynamical Systems. IEEE Control Systems Magazine 29, 2 (2009), 28--93.
[21]
Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. The MIT Press.
[22]
Clinton Heinze, Michael Papasimeon, and Simon Goss. 2000. Specifying Agent Behaviour with Use Cases. Springer Berlin Heidelberg, Berlin, Heidelberg, 128--142.
[23]
Clint Heinze, Michael Papasimeon, Simon Goss, Martin Cross, and Russell Connell. 2008. Simulating Fighter Pilots. Birkhäuser Basel, Basel, 113--130.
[24]
Clint Heinze, Bradley Smith, and Martin Cross. 1998. Thinking quickly: Agents for modeling air warfare. Springer Berlin Heidelberg, Berlin, Heidelberg, 47--58.
[25]
David G. Hull. 2007. Fundamentals of Airplane Flight Mechanics (2nd ed.). Springer.
[26]
Falilat Jimoh and Thomas Leo McCluskey. 2016. Towards The Integration of Model Predictive Control into an AI Planning Framework. In UK Planning Special Interest Group Workshop.
[27]
Levente Kocsis and Csaba Szepevari. 2006. Bandit Based Monte Carlo Planning. In Proc. of European Conference in Machine Learning (ECML).
[28]
Edward A. Lee and Sanjit A. Seshia. 2016. Introduction to embedded systems: A cyber-physical systems approach. MIT Press.
[29]
Daniel Liberzon. 2012. Switching in Systems and Control. Springer Science & Business Media.
[30]
Nir Lipovetzky and Héctor Gefner. 2012. Width and Serialization of Classical Planning Problems. In Proc. of European Conference on Artiicial Intelligence (ECAI).
[31]
Nir Lipovetzky, Miquel Ramirez, and Hector Gefner. 2015. Classical planning with simulators: results on the Atari video games. In Proc. of Int'l Joint Conf. in Artiicial Intelligence (IJCAI).
[32]
Johannes Löhr, Patrick Eyerich, Thomas Keller, and Bernhard Nebel. 2012. A Planning Based Framework for Controlling Hybrid Systems. In Proc. of the Int'l Conf. in Automated Planning and Scheduling (ICAPS).
[33]
Kevin McDonald, Lyndon Benke, and Michael Papasimeon. 2015. Team Oriented Execution Models for Multi-Agent Simulation of Air Combat. In Proceedings of the 21st International Congress on Modelling and Simulation (MODSIM 2015).
[34]
Kevin McDonald and Michael Papasimeon. 2015. Augmented Reality as an Interface to Air Combat Multi-Agent Simulation. In Proceedings of the 2015 Simulation and Technology Conference (SimTect 2015).
[35]
James S. McGrew and Jonathan P. How. 2010. Air Combat Strategy using Approximate Dynamic Programming. Journal of Guidance, Control and Dynamics 33 (2010), 1641 - 1654.
[36]
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al. 2015. Human-level control through deep reinforcement learning. Nature 518 (2015), 529.
[37]
Igor Mordatch, Nikhil Mishra, Clemens Eppner, and Pieter Abbeel. 2016. Combining model-based policy search with online model learning for control of physical humanoids. In Proc. of the IEEE Int'l Conference on Robotics and Automation (ICRA).
[38]
Michael Papasimeon, Lyndon Benke, Richard Brain, and Lily Finkelshtein. 2018. Multiagent Simulation of Adversarial Socio-Technical Systems. In Proc. of the Int'l Conference on Autonomous Agents and Multiagent Systems.
[39]
Hyunju Park, Byung-Yoon Lee, Min-Jea Tahk, and Dong-Wan Yoo. 2016. Diferential Game Based Air Combat Maneuver Generation Using Scoring Function Matrix. International Journal Of Aeronautical AND Space Sciences 17, 2 (2016), 204--213.
[40]
Wiktor Mateusz Piotrowski, Maria Fox, Derek Long, Daniele Magazzeni, and Fabio Mercorio. 2016. Heuristic Planning for PDDL+ Domains. In Proc. of Int'l Joint Conf. in Artiicial Intelligence (IJCAI).
[41]
Miquel Ramirez, Michael Papasimeon, Lyndon Behnke, Nir Lipovetzky, Tim Miller, and Adrian R. Pearce. 2017. Real-Time UAV Maneuvering via Automated Planning in Simulations. In Proc. of Int'l Joint Conf. in Artiicial Intelligence (IJCAI).
[42]
Raymond Reiter. 2001. Knowledge in action: logical foundations for specifying and implementing dynamical systems. MIT press.
[43]
Arthur Richards and Jonathan P. How. 2003. Aircraft trajectory planning with collision avoidance using mixed integer linear programming. In American Control Conference.
[44]
Enrico Scala. 2013. Numeric Kernel for Reasoning about Plans Involving Numeric Fluents. In AI*IA 2013: Advances in Artiicial Intelligence: Proc. Int'l Conf. of the Italian Association for Artiicial Intelligence, Matteo Baldoni et al (Ed.). Springer International Publishing, 263--275.
[45]
Enrico Scala, Patrik Haslum, Sylvie Thiebaux, and Miquel Ramirez. 2016. Interval? Based Relaxation for General Numeric Planning. In Proc. of European Conference on Artiicial Intelligence (ECAI).
[46]
Robert L. Shaw. 1985. Fighter Combat: Tactics and Maneuvering. Naval Institute Press.
[47]
David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. 2016. Mastering the Game of Go with Deep Neural Networks and Tree Search. Nature 529 (2016), 484--489.
[48]
Gil Tidhar, Clinton Heinze, and Mario Selvestrel. 1998. Flying Together: Modelling Air Mission Teams. Applied Intelligence 8, 3 (1998), 195--218.
Index Terms
- Integrated Hybrid Planning and Programmed Control for Real Time UAV Maneuvering
Recommendations
Autonomic Agents for Real Time UAV Mission Planning
UIC-ATC '13: Proceedings of the 2013 IEEE 10th International Conference on Ubiquitous Intelligence & Computing and 2013 IEEE 10th International Conference on Autonomic & Trusted ComputingThis paper investigates agent-based modelling and design of a real time mission planning module for an Unmanned Aerial Vehicle (UAV). Agents can act on behalf of remote human operators, who impose mission objectives, performing autonomous or supervised ...
Modeling and Simulation of the HADA Reconfigurable UAV
The "Helicopter ADaptive Aircraft" (HADA) is a reconfigurable UAV that performs both as a helicopter for take-off, landing and hovering flight, but that "morphs" in flight to a conventional fixed wing configuration for cruise flight, unfolding the wings ...
Real-time UAV maneuvering via automated planning in simulations
IJCAI'17: Proceedings of the 26th International Joint Conference on Artificial IntelligenceThe automatic generation of realistic behaviour such as tactical intercepts for Unmanned Aerial Vehicles (UAV) in air combat is a challenging problem. State-of-the-art solutions propose handcrafted algorithms and heuristics whose performance depends ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2018
2312 pages
- General Chairs:
- Elisabeth Andre,
- Sven Koenig,
- Program Chairs:
- Mehdi Dastani,
- Gita Sukthankar
Sponsors
In-Cooperation
Publisher
International Foundation for Autonomous Agents and Multiagent Systems
Richland, SC
Publication History
Published: 09 July 2018
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Australian Defence Science Institute
Conference
AAMAS '18
Sponsor:
Acceptance Rates
AAMAS '18 Paper Acceptance Rate 149 of 607 submissions, 25%;
Overall Acceptance Rate 1,155 of 5,036 submissions, 23%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 132Total Downloads
- Downloads (Last 12 months)10
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in