Abstract
Due to a rising number of entities and more advanced systems, modern air combat engagements are increasing in complexity. Therefore, to ensure success in pilot training and perform accurate threat evaluation using simulations, it is substantial to not only replicate and simulate the physical properties of the Computer-Generated forces (CGFs) to an adequate degree but also to provide them with sufficiently realistic, coordinated and situation-adaptive behavior. Additionally, most air combat research assumes that all aircraft information is known, however, in real-world scenarios, multiple factors, such as sensor performance limitations, can lead to missing or incorrect information about the position, altitude, or velocity of adversary aircraft. In this paper, we propose a Tactical Planning Process as part of an overarching CGF Team Behavior Agent Function utilizing information such as threat risk and the enemy’s intent from a Situation Analysis created with realistically available data. This process is partitioned into two stages, Team Planning and Maneuver Selection. Team Planning consists of deciding whether the mission itself should be commenced or aborted, selecting Tactics to counter the threats, as well as performing a Targeting in which threat aircraft are assigned to the individual CGFs. Further, in Maneuver Selection, the own current risks are assessed and used to continuously decide the current task for each CGF with respect to its target. Following, the maneuver command itself is being selected and sent to the simulated aircraft. This is done within an evaluation of the own chances and risks by, in a first step, identifying suitable tactical maneuver types, in a second step, narrow down their parameters, so that, in the final step, predicted risks from the Situation Analysis can be incorporated in the selection process as well. We employ Behavior Trees to guide the CGFs through these different tasks, while repeatedly assessing the developing risks to be able to adjust the behavior plan if needed. In this paper, we showcase this process within an air combat sample scenario implementation and provide an outlook on potential AI methods we intend to use in the future, along with their applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Higby, P.: Promise and Reality: Beyond Visual Range (BVR) Air-To-Air Combat (2005). http://pogoarchives.org/labyrinth/11/09.pdf
Xianyong, J., Hou, M., Wu, G., Ma, Z., Tao, Z.: Research on maneuvering decision algorithm based on improved deep deterministic policy gradient. IEEE Access (2022).https://doi.org/10.1109/ACCESS.2022.3202918
Hu, D., Yang, R., Zuo, J., Zhang, Z., Wu, J., Wang, Y.: Application of deep reinforcement learning in maneuver planning of beyond-visual-range air combat. IEEE Access (2021). https://doi.org/10.1109/ACCESS.2021.3060426
Bae, J.H., Jung, H., Kim, S., Kim, S., Kim, Y.D.: Deep reinforcement learning-based air-to-air combat maneuver generation in a realistic environment. IEEE Access (2023). https://doi.org/10.1109/ACCESS.2023.3257849
Tuyls, K., Weiss, G.: Multiagent learning: basics, challenges, and prospects. AI Mag (2012). https://doi.org/10.1609/aimag.v33i3.2426
Stone, P., Veloso, M.: Multiagent systems: a survey from a machine learning perspective. Auton. Robots (2000). https://doi.org/10.1023/A:1008942012299
Ruther, P., Strohal, M., Stütz, P.: A situation analysis process for computer-generated forces within air combat simulations under risk and uncertainty. Concept and first implementations. In: MESAS 2023 (2023)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach (2020)
Richards, C.: Boyds OODA Loop. Necesse, pp. 142–165 (2020)
Craig Conlter, R.(ed.): Implementation of the Pure Pursuit Path Tracking Algorithm
Michele Colledanchise, P.Ö.: Behavior Trees in Robotics and AI: An Introduction (2018)
Rovida, F., Grossmann, B., Krüger, V.: Extended behavior trees for quick definition of flexible robotic tasks. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017, Vancouver, BC, Canada, 24–28 September 2017, pp. 6793–6800. IEEE (2017). https://doi.org/10.1109/IROS.2017.8206598
Coronado, E., Mastrogiovanni, F., Venture, G.: Development of intelligent behaviors for social robots via user-friendly and modular programming tools. In: 2018 IEEE Workshop on Advanced Robotics and its Social Impacts, ARSO 2018, Genova, Italy, 27–29 September 2018, pp. 62–68. IEEE (2018). https://doi.org/10.1109/ARSO.2018.8625839
Davide Faconti, E.: BehaviorTree. CPP (2018)
Costley, A., Droge, G., Christensen, R., Leishman, R.C., Swedeen, J.: Path Planning with Uncertainty for Aircraft Under Threat of Detection from Ground-Based Radar. CoRR (2022). https://doi.org/10.48550/arXiv.2207.03716
Crumpacker, J.B., Robbins, M.J., Jenkins, P.R.: An approximate dynamic programming approach for solving an air combat maneuvering problem. Expert Syst. Appl. (2022). https://doi.org/10.1016/j.eswa.2022.117448
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Reinisch, F., Strohal, M., Stütz, P. (2025). A Tactical Planning Process in Computer-Generated Forces Team Behavior Within Air Combat Simulations: Concept and First Implementations. In: Mazal, J., et al. Modelling and Simulation for Autonomous Systems. MESAS 2023. Lecture Notes in Computer Science, vol 14615. Springer, Cham. https://doi.org/10.1007/978-3-031-71397-2_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-71397-2_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-71396-5
Online ISBN: 978-3-031-71397-2
eBook Packages: Computer ScienceComputer Science (R0)