Abstract
Designing/configuring ensemble Differential Evolution (DE) algorithms with complementary search characteristics is a complex problem requiring both in-depth understanding of the constituent algorithm’s dynamics and tacit knowledge. This paper proposes a Grammatical Evolution (GE) based automated configuration of a recent ensemble DE algorithm - Improved Multi-population Ensemble Differential Evolution (IMPEDE). A Backus Naur Form grammar, with nine ensemble and DE parameters, has been designed to represent all possible IMPEDE configurations. The proposed approach has been employed to evolve IMPEDE configurations that solve CEC’17 benchmark optimization problems. The evolved configurations have been validated on CEC’14 suite and a real-world optimization problem - economic load dispatch (ELD) problem - from CEC’11 suite. The simulation experiments demonstrate that the proposed approach is capable of evolving IMPEDE configurations that exhibit statistically superior or comparable performance against the manual configuration of IMPEDE as well as against other prominent ensemble DE algorithms.
Similar content being viewed by others
References
Awad, N.H., Ali, M.Z., Liang, J.J., Qu, B.Y., Suganthan, P.N.: Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective real-parameter numerical optimization. Technical report, Nanyang Technological University (2016)
Bilal, P.M., Zaheer, H., Garcia-Hernandez, L., Abraham, A., et al.: Differential evolution: a review of more than two decades of research. Eng. Appl. Artif. Intell. 90, 103479 (2020)
Burke, E.K., Hyde, M.R., Kendall, G.: Grammatical evolution of local search heuristics. IEEE Trans. Evol. Comput. 16(3), 406–417 (2011)
Das, S., Mullick, S.S., Suganthan, P.N.: Recent advances in differential evolution-an updated survey. Swarm Evol. Comput. 27, 1–30 (2016)
Das, S., Suganthan, P.N.: Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems. Technical report, Nanyang Technological University (2010)
Dhanalakshmy, D.M., Akhila, M., Vidhya, C., Jeyakumar, G.: Improving the search efficiency of differential evolution algorithm by population diversity analysis and adaptation of mutation step sizes. Int. J. Adv. Intell. Paradigms 15(2), 119–145 (2020)
Fenton, M., McDermott, J., Fagan, D., Forstenlechner, S., Hemberg, E., O’Neill, M.: PonyGE2: grammatical evolution in python. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1194–1201. ACM (2017)
Indu, M.T., Shunmuga Velayutham, C.: Towards grammatical evolution-based automated design of differential evolution algorithm. In: Sharma, H., Saraswat, M., Yadav, A., Kim, J.H., Bansal, J.C. (eds.) CIS 2020. AISC, vol. 1335, pp. 329–340. Springer, Singapore (2021). https://doi.org/10.1007/978-981-33-6984-9_27
Li, X., Dai, G.: An enhanced multi-population ensemble differential evolution. In: Proceedings of the 3rd International Conference on Computer Science and Application Engineering, pp. 1–5. ACM (2019). https://doi.org/10.1145/3331453.3362054
Li, X., Wang, L., Jiang, Q., Li, N.: Differential evolution algorithm with multi-population cooperation and multi-strategy integration. Neurocomputing 421, 285–302 (2021)
Liang, J., Qu, B., Suganthan, P.: Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Technical report, Nanyang Technological University (2013)
López-Ibáñez, M., Dubois-Lacoste, J., Cáceres, L.P., Birattari, M., Stützle, T.: The irace package: iterated racing for automatic algorithm configuration. Oper. Res. Perspect. 3, 43–58 (2016). https://doi.org/10.1016/j.orp.2016.09.002
Lourenço, N., Pereira, F.B., Costa, E.: The importance of the learning conditions in hyper-heuristics. In: Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, pp. 1525–1532 (2013)
Ma, H., Shen, S., Yu, M., Yang, Z., Fei, M., Zhou, H.: Multi-population techniques in nature inspired optimization algorithms: a comprehensive survey. Swarm Evol. Comput. 44, 365–387 (2019)
Mweshi, G., Pillay, N.: An improved grammatical evolution approach for generating perturbative heuristics to solve combinatorial optimization problems. Expert Syst. Appl. 165, 113853 (2021)
Nyathi, T., Pillay, N.: Comparison of a genetic algorithm to grammatical evolution for automated design of genetic programming classification algorithms. Expert Syst. Appl. 104, 213–234 (2018)
O’Neill, M., Ryan, C.: Grammatical evolution. IEEE Trans. Evol. Comput. 5(4), 349–358 (2001). https://doi.org/10.1109/4235.942529
RV, S.D., Kalyan, R., Kurup, D.G., et al.: Optimization of digital predistortion models for RF power amplifiers using a modified differential evolution algorithm. AEU-Int. J. Electron. Commun. 124, 153323 (2020)
Sree, K.V., Jeyakumar, G.: An evolutionary computing approach to solve object identification problem for fall detection in computer vision-based video surveillance applications. In: Hemanth, D.J., Kumar, B.V., Manavalan, G.R.K. (eds.) Recent Advances on Memetic Algorithms and its Applications in Image Processing. SCI, vol. 873, pp. 1–18. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-1362-6_1
Storn, R., Price, K.: Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997). https://doi.org/10.1023/A:1008202821328
Tavares, J., Pereira, F.B.: Automatic design of ant algorithms with grammatical evolution. In: Moraglio, A., Silva, S., Krawiec, K., Machado, P., Cotta, C. (eds.) EuroGP 2012. LNCS, vol. 7244, pp. 206–217. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29139-5_18
Tong, L., Dong, M., Jing, C.: An improved multi-population ensemble differential evolution. Neurocomputing 290, 130–147 (2018)
Wu, G., Mallipeddi, R., Suganthan, P.N.: Swarm Evol. Comput. 44, 695–711 (2019). https://doi.org/10.1016/j.swevo.2018.08.015
Wu, G., Mallipeddi, R., Suganthan, P.N., Wang, R., Chen, H.: Differential evolution with multi-population based ensemble of mutation strategies. Inf. Sci. 329, 329–345 (2016). https://doi.org/10.1016/j.ins.2015.09.009
Wu, G., Shen, X., Li, H., Chen, H., Lin, A., Suganthan, P.N.: Ensemble of differential evolution variants. Inf. Sci. 423, 172–186 (2018)
Zhang, J., Sanderson, A.C.: JADE: adaptive differential evolution with optional external archive. IEEE Trans. Evol. Comput. 13(5), 945–958 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Indu, M.T., Velayutham, C.S. (2023). A Grammatical Evolution Based Automated Configuration of an Ensemble Differential Evolution Algorithm. In: Maji, P., Huang, T., Pal, N.R., Chaudhury, S., De, R.K. (eds) Pattern Recognition and Machine Intelligence. PReMI 2023. Lecture Notes in Computer Science, vol 14301. Springer, Cham. https://doi.org/10.1007/978-3-031-45170-6_61
Download citation
DOI: https://doi.org/10.1007/978-3-031-45170-6_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-45169-0
Online ISBN: 978-3-031-45170-6
eBook Packages: Computer ScienceComputer Science (R0)