More Web Proxy on the site http://driver.im/

research-article

A dimensional difference-based population size adjustment framework for differential evolution

Authors:

Lili ZhangAuthors Info & Claims

Volume 660, Issue C

https://doi.org/10.1016/j.ins.2024.120110

Published: 17 April 2024 Publication History

Abstract

Aiming at the problems of premature convergence and evolutionary stagnation faced by differential evolution (DE), a dimensional difference-based population size adjustment framework (DDPSA) is proposed in this work. The framework monitors the speed of convergence based on the dimensional difference between the parent and the offspring, to judge the problem faced by the current population. An adaptive mechanism of population size is designed at the population level to adjust the convergence speed and avoid the above two issues timely. Besides, For the two types of stagnant individuals caused by premature convergence and evolutionary stagnation, two replacement techniques based on the history and elite are proposed at the individual level, respectively, to assist them in restoring normal evolution, cooperating with the mechanism of population size adjustment. The DDPSA framework is introduced into ten DE algorithms and tested in the CEC 2014 and CEC 2017 benchmark suites, as well as four practical problems. The experimental results show that the DDPSA framework can effectively enhance the competitiveness of DEs, which is particularly obvious in some complex multimodal scenarios, achieving significant improvement in terms of DEs' performance on 71.4% and 60.5% of multimodal functions in CEC 2014 and CEC 2017, respectively.

Highlights

•

A mechanism is designed to identify premature convergence and stagnation.

•

An adaptive size adjustment scheme is proposed at the population level.

•

Two types of replacement techniques are introduced at the individual level.

•

DDPSA framework can effectively improve the search efficiency of DE algorithms.

•

DDPSA framework can be easily embedded into various DE algorithms.

References

[1]

M.F. Ahmad, N.A.M. Isa, W.H. Lim, K.M. Ang, Differential evolution: a recent review based on state-of-the-art works, Alex. Eng. J. 61 (2022) 3831–3872.

[2]

N.H. Awad, M.Z. Ali, P.N. Suganthan, Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving cec2017 benchmark problems, in: 2017 IEEE Congress on Evolutionary Computation (CEC), IEEE, 2017, pp. 372–379.

[3]

P.P. Biswas, P.N. Suganthan, Large initial population and neighborhood search incorporated in lshade to solve cec2020 benchmark problems, in: 2020 IEEE Congress on Evolutionary Computation (CEC), IEEE, 2020, pp. 1–7.

[4]

P. Bujok, P. Kolenovsky, V. Janisch, Eigenvector crossover in jde100 algorithm, in: 2020 IEEE Congress on Evolutionary Computation (CEC), IEEE, 2020, pp. 1–6.

[5]

J. Carrasco, S. García, M. Rueda, S. Das, F. Herrera, Recent trends in the use of statistical tests for comparing swarm and evolutionary computing algorithms: practical guidelines and a critical review, Swarm Evol. Comput. 54 (2020).

[6]

S. Das, P.N. Suganthan, Problem Definitions and Evaluation Criteria for CES 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems, Jadavpur University, Nanyang Technological University, Kolkata, 2010, pp. 341–359.

[7]

L. Deng, Y. Qin, C. Li, L. Zhang, An adaptive mutation strategy correction framework for differential evolution, Neural Comput. Appl. 35 (2023) 11161–11182.

[8]

L.B. Deng, S. Wang, L.Y. Qiao, B.Q. Zhang, DE-RCO: rotating crossover operator with multiangle searching strategy for adaptive differential evolution, IEEE Access 6 (2017) 2970–2983.

[9]

L.B. Deng, L.L. Zhang, N. Fu, H.l. Sun, L.Y. Qiao, ERG-DE: an elites regeneration framework for differential evolution, Inf. Sci. 539 (2020) 81–103.

[10]

W. Deng, H. Liu, J. Xu, H. Zhao, Y. Song, An improved quantum-inspired differential evolution algorithm for deep belief network, IEEE Trans. Instrum. Meas. 69 (2020) 7319–7327.

[11]

W. Deng, S. Shang, X. Cai, H. Zhao, Y. Song, J. Xu, An improved differential evolution algorithm and its application in optimization problem, Soft Comput. 25 (2021) 5277–5298.

[12]

Y. Dong, H. Zhang, C. Wang, X. Zhou, A novel hybrid model based on Bernstein polynomial with mixture of Gaussians for wind power forecasting, Appl. Energy 286 (2021).

[13]

A. Draa, S. Bouzoubia, I. Boukhalfa, A sinusoidal differential evolution algorithm for numerical optimisation, Appl. Soft Comput. 27 (2015) 99–126.

Digital Library

[14]

C. García-Martínez, M. Lozano, F. Herrera, D. Molina, A.M. Sánchez, Global and local real-coded genetic algorithms based on parent-centric crossover operators, Eur. J. Oper. Res. 185 (2008) 1088–1113.

[15]

A. Ghosh, S. Das, A.K. Das, R. Senkerik, A. Viktorin, I. Zelinka, A.D. Masegosa, Using spatial neighborhoods for parameter adaptation: an improved success history based differential evolution, Swarm Evol. Comput. 71 (2022).

[16]

L. Gui, X. Xia, F. Yu, H. Wu, R. Wu, B. Wei, Y. Zhang, X. Li, G. He, A multi-role based differential evolution, Swarm Evol. Comput. 50 (2019).

[17]

S. Gupta, R. Su, An efficient differential evolution with fitness-based dynamic mutation strategy and control parameters, Knowl.-Based Syst. 251 (2022).

[18]

S. Gupta, R. Su, Multiple individual guided differential evolution with time varying and feedback information-based control parameters, Knowl.-Based Syst. 259 (2023).

[19]

F. Herrera, M. Lozano, Gradual distributed real-coded genetic algorithms, IEEE Trans. Evol. Comput. 4 (2000) 43–63.

[20]

J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of ICNN'95-International Conference on Neural Networks, IEEE, 1995, pp. 1942–1948.

[21]

C. Li, G. Sun, L. Deng, L. Qiao, G. Yang, A population state evaluation-based improvement framework for differential evolution, Inf. Sci. 629 (2023) 15–38.

[22]

Y. Li, T. Han, S. Tang, C. Huang, H. Zhou, Y. Wang, An improved differential evolution by hybridizing with estimation-of-distribution algorithm, Inf. Sci. 619 (2023) 439–456.

[23]

Y. Li, T. Han, X. Wang, H. Zhou, S. Tang, C. Huang, B. Han, Mjso: a modified differential evolution with a probability selection mechanism and a directed mutation strategy, Swarm Evol. Comput. 78 (2023).

[24]

J.J. Liang, B.Y. Qu, P.N. Suganthan, Problem definitions and evaluation criteria for the cec 2014 special session and competition on single objective real-parameter numerical optimization, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report Nanyang Technological University, Singapore, 2013, p. 635.

[25]

Z. Meng, Dimension improvements based adaptation of control parameters in differential evolution: a fitness-value-independent approach, Expert Syst. Appl. 223 (2023).

[26]

Z. Meng, J.S. Pan, Hard-de: hierarchical archive based mutation strategy with depth information of evolution for the enhancement of differential evolution on numerical optimization, IEEE Access 7 (2019) 12832–12854.

[27]

S. Mirjalili, S.M. Mirjalili, A. Lewis, Grey wolf optimizer, Adv. Eng. Softw. 69 (2014) 46–61.

Digital Library

[28]

A.P. Piotrowski, Review of differential evolution population size, Swarm Evol. Comput. 32 (2017) 1–24.

[29]

R. Poláková, J. Tvrdík, P. Bujok, Differential evolution with adaptive mechanism of population size according to current population diversity, Swarm Evol. Comput. 50 (2019).

[30]

R. Storn, K. Price, Differential Evolution—a Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces, International Computer Science Institute, Berkeley, Berkeley, CA, 1995.

[31]

G. Sun, B. Yang, Z. Yang, G. Xu, An adaptive differential evolution with combined strategy for global numerical optimization, Soft Comput. 24 (2020) 6277–6296.

[32]

R. Tanabe, A. Fukunaga, Success-history based parameter adaptation for differential evolution, in: 2013 IEEE Congress on Evolutionary Computation, IEEE, 2013, pp. 71–78.

[33]

R. Tanabe, A.S. Fukunaga, Improving the search performance of shade using linear population size reduction, in: 2014 IEEE Congress on Evolutionary Computation (CEC), IEEE, 2014, pp. 1658–1665.

[34]

N.S. Teng, J. Teo, M.H.A. Hijazi, Self-adaptive population sizing for a tune-free differential evolution, Soft Comput. 13 (2009) 709–724.

[35]

M. Tian, X. Gao, Differential evolution with neighborhood-based adaptive evolution mechanism for numerical optimization, Inf. Sci. 478 (2019) 422–448.

[36]

M. Tian, X. Gao, An improved differential evolution with information intercrossing and sharing mechanism for numerical optimization, Swarm Evol. Comput. 50 (2019).

[37]

M. Tian, X. Gao, X. Yan, Performance-driven adaptive differential evolution with neighborhood topology for numerical optimization, Knowl.-Based Syst. 188 (2020).

[38]

G.G. Wang, D. Gao, W. Pedrycz, Solving multiobjective fuzzy job-shop scheduling problem by a hybrid adaptive differential evolution algorithm, IEEE Trans. Ind. Inform. 18 (2022) 8519–8528.

[39]

G. Wu, R. Mallipeddi, P.N. Suganthan, Problem definitions and evaluation criteria for the cec 2017 competition on constrained real-parameter optimization, National University of Defense Technology, Changsha, Hunan, PR China and Kyungpook National University, Daegu, South Korea and Nanyang Technological University, Singapore, Technical Report 2017.

[40]

G. Wu, X. Shen, H. Li, H. Chen, A. Lin, P.N. Suganthan, Ensemble of differential evolution variants, Inf. Sci. 423 (2018) 172–186.

Digital Library

[41]

X. Yan, M. Tian, Differential evolution with two-level adaptive mechanism for numerical optimization, Knowl.-Based Syst. 241 (2022).

[42]

M. Yang, C. Li, Z. Cai, J. Guan, Differential evolution with auto-enhanced population diversity, IEEE Trans. Cybern. 45 (2014) 302–315.

[43]

Z. Zeng, Z. Hong, H. Zhang, M. Zhang, C. Chen, Improving differential evolution using a best discarded vector selection strategy, Inf. Sci. 609 (2022) 353–375.

[44]

Z. Zeng, H. Zhang, An evolutionary-state-based selection strategy for enhancing differential evolution algorithm, Inf. Sci. 617 (2022) 373–394.

[45]

Z. Zeng, M. Zhang, T. Chen, Z. Hong, A new selection operator for differential evolution algorithm, Knowl.-Based Syst. 226 (2021).

[46]

J. Zhang, A.C. Sanderson, Jade: adaptive differential evolution with optional external archive, IEEE Trans. Evol. Comput. 13 (2009) 945–958.

Digital Library

[47]

S.X. Zhang, Y.N. Wen, Y.H. Liu, L.M. Zheng, S.Y. Zheng, Differential evolution with domain transform, IEEE Trans. Evol. Comput. (2022).

[48]

X. Zhang, Q. Liu, Y. Qu, An adaptive differential evolution algorithm with population size reduction strategy for unconstrained optimization problem, Appl. Soft Comput. 138 (2023).

[49]

W. Zhu, Y. Tang, J.a. Fang, W. Zhang, Adaptive population tuning scheme for differential evolution, Inf. Sci. 223 (2013) 164–191.

Recommendations

Population size reduction for the differential evolution algorithm

This paper studies the efficiency of a recently defined population-based direct global optimization method called Differential Evolution with self-adaptive control parameters. The original version uses fixed population size but a method for gradually ...
Differential evolution with improved population reduction
GECCO '11: Proceedings of the 13th annual conference companion on Genetic and evolutionary computation

In the Differential Evolution (DE), there are many adaptive DE algorithms proposed for parameter adaptation. However, they are mainly focus on the the mutation factor F and crossover probability CR. The adaptation of population size NP is not widely ...
A population state evaluation-based improvement framework for differential evolution
Abstract
Differential evolution (DE) is one of the most efficient evolutionary algorithms for solving numerical optimization problems; however, it still suffers from premature convergence and stagnation. To address these problems, we propose a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Information Sciences: an International Journal

Information Sciences: an International Journal Volume 660, Issue C

Mar 2024

599 pages

Issue’s Table of Contents

Elsevier Inc.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 17 April 2024

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents