Abstract
Hybrid systems are dynamical systems of both continuous and discrete nature and constitute an important field of control systems theory and engineering. On the other hand, intelligent data processing has become one of the most critical devices of modern computer based systems as these systems operate in environments featuring increasing uncertainty and unpredictability. While these two approaches set completely different objectives, modern cyber-physical systems, taken as variants of hybrid systems, seem to constitute a field of increasing interest for applying intelligent techniques. Moreover, the examples of, not so recent, intelligent control systems are suggestive for considering a study on getting intelligent techniques close to hybrid systems. In this paper we present the experimental investigation we undertook in this direction. More specifically, we present and discuss the experiments carried out using Acumen a hybrid systems modeling and simulation environment. Without urging towards setting and solving questions of conceptual order we tried to figure out whether it is possible to represent intelligent behavior using a tool for modeling dynamical systems focusing on the study of its ability to permit the representation of both continuous and discrete intelligent techniques, namely, Reinforcement Learning and Hopfield neural networks. The results obtained are indicative of the problems related to the specific computational context and are useful in deriving conclusions concerning the functionality that needs to be provided by such modeling and simulation environments, in order to allow for the coexistence of hybrid systems and intelligent techniques.
Part of this work was conducted by Sotirios Tzamaras, during his internship at the University of Halmstad, funded by the Erasmus+ program.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alur, R., et al.: The algorithmic analysis of hybrid systems. Theoret. Comput. Sci. 138(1), 3–34 (1995)
Antsaklis, P.J.: On Intelligent Control: Report of the IEEE CSS Task Force on Intelligent Control. Technical report, University of Notre Dame (January 1994)
Busoniu, L., de Bruin, T., Tolić, D., Kober, J., Palunko, I.: Reinforcement learning for control: performance, stability, and deep approximators. Ann. Rev. Control 46, 8–28 (2018)
Effective Modeling Group: Acumen modeling language. http://acumen-language.org
Fleming, P., Purshouse, R.: Evolutionary algorithms in control systems engineering: a survey. Control Eng. Pract. 10(11), 1223–1241 (2002)
Javadi-Moghaddam, J., Bagheri, A.: An adaptive neuro-fuzzy sliding mode based genetic algorithm control system for under water remotely operated vehicle. Expert Syst. Appl. 37(1), 647–660 (2010)
Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. intell. Res. 4, 237–285 (1996)
Koch, W., Mancuso, R., West, R., Bestavros, A.: Reinforcement learning for UAV attitude control. ACM Trans. Cyber-Phys. Syst. 3(2), 1–21 (2019)
Lee, C., Kim, J., Babcock, D., Goodman, R.: Application of neural networks to turbulence control for drag reduction. Phys. Fluids 9(6), 1740–1747 (1997)
Lemmon, M., Antsaklis, P.: Hybrid systems and intelligent control. In: Proceedings of 8th IEEE International Symposium on Intelligent Control, pp. 174–179 (1993)
Lukianykhin, O., Bogodorova, T.: ModelicaGym: applying reinforcement learning to Modelica models. In: Proceedings of the 9th International Workshop on Equation-based Object-oriented Modeling Languages and Tools, pp. 27–36 (2019)
Moe, S., Rustad, A.M., Hanssen, K.G.: Machine learning in control systems: an overview of the state of the art. In: Bramer, M., Petridis, M. (eds.) SGAI 2018. LNCS (LNAI), vol. 11311, pp. 250–265. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04191-5_23
Odersky, M., Spoon, L., Venners, B.: Programming in Scala. Artima Inc, Mountain View (2008)
Olowononi, F.O., Rawat, D.B., Liu, C.: Resilient machine learning for networked cyber physical systems: a survey for machine learning security to securing machine learning for CPS. IEEE Commun. Surv. Tutorials 23(1), 524–552 (2021)
Quade, M., Isele, T., Abel, M.: Explainable Machine Learning Control - robust control and stability analysis (2020)
Radanliev, P., De Roure, D., Van Kleek, M., Santos, O., Ani, U.: Artificial intelligence in cyber physical systems. AI Soc. 1–14 (2020) https://doi.org/10.1007/s00146-020-01049-0
Schaub, A., Hellerer, M., Bodenmüller, T.: Simulation of artificial intelligence agents using modelica and the DLR visualization library. In: Proceedings of the 9th International MODELICA Conference, pp. 339–346 (2012)
Taha, W., et al.: Acumen: an open-source testbed for cyber-physical systems research. In: Mandler, B., et al. (eds.) IoT360 2015. LNICST, vol. 169, pp. 118–130. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47063-4_11
van Otterlo, M., Wiering, M.: Reinforcement learning and Markov decision processes. In: Wiering, M., van Otterlo, M. (eds.) Reinforcement Learning. Adaptation, Learning, and Optimization, vol. 12, pp. 3–42. Springer, Berlin (2012). https://doi.org/10.1007/978-3-642-27645-3_1
Wang, Y., Velswamy, K., Huang, B.: A novel approach to feedback control with deep reinforcement learning. IFAC-PapersOnLine 51(18), 31–36 (2018). 10th IFAC Symposium on Advanced Control of Chemical Processes ADCHEM 2018
Zhu, Y., R., et al.: Mathematical equations as executable models of mechanical systems. In: Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems, pp. 1–11 (2010)
Acknowledgments
The authors would like to thank the anonymous reviewers for their suggestions and comments on earlier version of the manuscript, that helped to improve the paper at hand.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Tzamaras, S., Adam, S., Taha, W. (2021). Intelligent Techniques and Hybrid Systems Experiments Using the Acumen Modeling and Simulation Environment. In: Maglogiannis, I., Macintyre, J., Iliadis, L. (eds) Artificial Intelligence Applications and Innovations. AIAI 2021. IFIP Advances in Information and Communication Technology, vol 627. Springer, Cham. https://doi.org/10.1007/978-3-030-79150-6_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-79150-6_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79149-0
Online ISBN: 978-3-030-79150-6
eBook Packages: Computer ScienceComputer Science (R0)