[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Self-Adaptive two roles hybrid learning strategies-based particle swarm optimization

Published: 01 November 2021 Publication History

Highlights

The method uses two-role learning strategy: exploration and exploitation ones.
The method uses success history-based self-adaptive learn parameter tuning strategy.
The method adopts bimodal distribution to self-adaptively set the inertia weight.
The results show the method outperforms or is comparable to other peer algorithms.

Abstract

Particle Swarm Optimization (PSO) is a simple yet efficient population based evolutionary algorithm, which has been widely applied to solve global optimization problems. Similar to other evolutionary algorithms (EAs), PSO algorithm still suffers from loss of diversity and slow convergence caused by the contradiction between exploration and exploitation abilities. In order to address the drawbacks, we propose Self-Adaptive two roles hybrid learning strategies-based particle swarm optimization (SAHLPSO) to improve optimization performance by using exploration-role and exploitation-role learning strategies with self-adaptively updating parameters manner. The exploration-role learning strategies with external archive adopt comprehensive learning to generate the learning exemplars, which can effectively maintain population diversity and thus avoid premature. On the other hand, the exploitation-role learning strategies utilize elitism learning to generate the learning exemplars so as to improve convergence performance. Considering that the performance improvement of PSO depends on not only the adaptation of different learning strategies but also the reasonable parameter settings, we also develop a self-adaptive parameter updating manner based on success history information. This manner can automatically update the learning parameters to appropriate values and avoid a user’s prior knowledge about the relationship between the parameter settings and the characteristics of optimization problems. In addition, the usage of the linear population size reduction is also helpful to well balance the exploration and exploitation along with the process of evolution. Simulation results on some classical and CEC2013 benchmark functions show that LSAHLPSO is better than other PSO variants or at least comparable to other state-of-the-art evolutionary algorithms.

References

[1]
M.J. Amoshahy, M. Shamsi, M.H. Sedaaghi, Y. Deng, A novel flexible inertia weight particle swarm optimization algorithm, PLOS One. 11 (8) (2016) e0161558,.
[2]
A. Ratnaweera, S.K. Halgamuge, H.C. Watson, Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients, IEEE. Trans. Evol. Comput. 8 (3) (2004) 240–255.
[3]
A.P. Lin, Global genetic learning particle swarm optimization swarm optimization with diversity enhancement by ring topology, Swarm Evol. Comput. 44 (2019) 571–583.
[4]
A.K. Qin, V.L. Huang, P.N. Suganthan, Differential evolution algorithm with strategy adaptation for global numerical optimization, IEEE Trans. Evol. Comput. 13 (2) (2009) 398–417.
[5]
B. Wei, X. Xia, F. Yu, Y. Zhang, X. Xu, H. Wu, L. Gui, G. He, Multiple adaptive strategies based particle swarm optimization algorithm, Swarm Evol. Comput. 57 (2020).
[6]
C. Xu, H.G. Tian, W.L. Du, Bee-foraging learning particle swarm optimization, Swarm, Evol. Comput. 102 (2021) 107–134.
[7]
D.O. Tian, Z.Z. Shi, MPSO: Modified particle swarm optimization and its applications, Swarm Evol. Comput. 41 (2018) 49–68.
[8]
F. Wang, H. Zhang, K. Li, Z. Lin, J. Yang, X.-L. Shen, A hybrid particle swarm optimization algorithm using adaptive learning strategy, Inf. Sci. 436-437 (2018) 162–177.
[9]
G.P. Xu, Particle swarm optimization base on dimensional learning strategy, Swarm Evol. Comput. 45 (2019) 33–51.
[10]
G. Wu, D. Qiu, Y. Yu, W. Pedrycz, M. Ma, H. Li, Superior solution guided particle swarm optimization combined with local search techniques, Expert Syst. Appl. 41 (16) (2014) 7536–7548.
[11]
H. Pang, F. Liu, Z. Xu, Variable universe fuzzy control for vehicle semi-active suspension system with MR damper combining fuzzy neural network and particle swarm optimization, Neurocomputing 306 (2018) 130–140.
[12]
H.-B. Ouyang, L.-Q. Gao, S. Li, X.-Y. Kong, Improved global-best-guided particle swarm optimization with learning operation for global optimization problems, Appl. Soft Comput. 52 (2017) 987–1008.
[13]
H. Wang, Y. Jin, J. Doherty, Committee-based active learning for surrogate-assisted particle swarm optimization of expensive problems, IEEE Trans. Cybern. 47 (9) (2017) 2664–2677.
[14]
J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proc. IEEE Int. Conf. Neural Netw, (1995) 1942–1948.
[15]
J.O. Pedro, M. Dangor, O.A. Dahunsi, M.M. Ali, Dynamic neural network-based feedback linearization control of full-car suspensionsusing pso, Appl. Soft. Comput. 70 (2018) 723–736.
[16]
J. Han, G. Zhang, Y. Hu, J. Lu, A solution to bi/tri-level programming problems using particle swarm optimization, Inf. Sci. 370-371 (2016) 519–537.
[17]
J. Li, Y. Zhang, X. Chen, Y. Xiang, Secure attribute-based data sharing for resource-limited users in cloud computing, Comput Secur. 72 (2018) 1–12.
[18]
J. Jeslin Drusila Nesamalar, P. Venkatesh, S. Charles Raja, Managing multi-line power congestion by using Hybrid Nelder–Mead–Fuzzy Adaptive Particle Swarm Optimization (HNM-FAPSO), Appl. Soft. Comput. 43 (2016) 222–234.
[19]
J.J. Liang, A.K. Qin, P.N. Suganthan, S. Baskar, Comprehensive learning particle swarm optimizer for global optimization of multimodal functions, IEEE Trans. Evol. Comput. 10 (3) (2006) 281–295.
[20]
J.J. Liang, P. Definitions, E. Criteria, for the CEC, Special Session on Realparameter Optimization, Technical report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China, 2013, Nanyang Technological University, Singapore, 2013.
[21]
K. Chen, F. Zhou, L. Yin, S. Wang, Y. Wang, F. Wan, A hybrid particle swarm optimizer with sine cosine acceleration coefficients, Inf. Sci. 422 (2018) 218–241.
[22]
K. Zhang, Q. Huang, Y. Zhang, Enhancing comprehensive learning particle swarm optimization with local optima topology, Inf. Sci. 471 (2019) 1–18.
[23]
L. Cao, L. Xu, E.D. Goodman, A neighbor-based learning particle swarm optimizer with short-term and long-term memory for dynamic optimization problems, Inf. Sci. 453 (2018) 463–485.
[24]
L.T. Al-Bahrani, J.C. Patra, a novel orthogonal PSO algorithm based on orthogonal diagonalization, Swarm Evol. Comput. 40 (2018) 1–23.
[25]
M.R. Tanweer, S. Suresh, N. Sundararajan, Self regulating particle swarm optimization algorithm, Inf. Sci. 294 (2015) 182–202.
[26]
M. Clerc, J. Kennedy, The particle swarm-explosion, stability, and convergence in a multidimensional complex space, IEEE Trans. Evol. Comput. 6 (1) (2002) 58–73.
[27]
M.S. Nobile, P. Cazzanign, D. Besozzi, Fuzzy Self-tuning PSO: A setting-free Aglorithm for Global Optimization, Swarm Evol. Comput. 39 (2017).
[28]
M.R. Tanweer, S. Suresh, N. Sundararajan, Dynamic mentoring and self-regulation based particle swarm optimization algorithm for solving complex real-world optimization problems, Inf. Sci. 326 (2016) 1–24.
[29]
M.R. Tanweer, R. Auditya, S. Suresh, N. Sundararajan, N. Srikanth, Directionally driven self-regulating particle swarm optimization algorithm, Swarm Evol. Comput. 28 (2016) 98–116.
[30]
N. Kalaiarasi, S. Paramasivam, S.S. Dash, P. Sanjeevikumar, L. Mihet-Popa, PSO based MPPT implementation in dspace controller integrated through z-source inverter for photovoltaic applications, Energies 9 (2017) 1–10.
[31]
N. Lynn, M.Z. Ali, P.N. Suganthan, Population topologies for particle swarm optimization and differential evolution, Swarm Evol. Comput. 39 (2018) 24–35.
[32]
N. Lynn, P.N. Suganthan, Ensemble particle swarm optimizer, Appl. Soft Comput. 55 (2017) 533–548.
[33]
N.-J. Li, W.-J. Wang, C.-C. James Hsu, Hybrid particle swarm optimization incorporating fuzzy reasoning and weighted particle, Neurocomputing. 167 (2015) 488–501.
[34]
N. Lynn, P.N. Suganthan, Heterogeneous comprehensive learning particle swarm optimization with enhancing exploration and exploitation, Swarm Evol. Comput. 24 (2015) 11–24.
[35]
N. Hansen, A. Ostermeier, Completely derandomized self-adaptation in evolution strategies, Evol. Comput. 9 (2) (2001) 159–195.
[36]
Q. Zhang, W. Liu, X. Meng, B. Yang, A.V. Vasilakos, Vector coevolving particle swarm optimization algorithm, Inf. Sci. 394-395 (2017) 273–298.
[37]
R. Cheng, Y. Jin, A social learning particle swarm optimization algorithm for scalable optimization, Inf. Sci. 291 (2015) 43–60.
[38]
R. Mendes, J. Kennedy, The fully informed particle swarm: simpler, maybe better, IEEE Trans. Evol. Comput. 8 (3) (2004) 204–210.
[39]
R. Tanabe, A.S. Fukunaga, Improving the Search Performance of SHADE Using Linear Population Size Reduction [C], IEEE Congress on Evolutionary Computation (CEC), July 6–11, 2014, Beijing, China, 2014.
[40]
W.H. Lim, N.A. Mat Isa, An adaptive two-layer particle swarm optimization with elitist learning strategy, Inf. Sci. 273 (2014) 49–72.
[41]
X. Xia, L. Gui, Z.-H. Zhan, A multi-swarm particle swarm optimization algorithm based on dynamical topology and purposeful detecting, Appl. Soft. Comput. 67 (2018) 126–140.
[42]
X. Tao, W. Guo, Q. Li, C. Ren, R. Liu, Multiple scale self-adaptive cooperation mutation strategy-based particle swarm optimization, Appl. Soft. Comput. 89 (2020) 106124,.
[43]
X. Xia, Y. Xing, B. Wei, Y. Zhang, X. Li, X. Deng, L. Gui, A fitness-based multi-role particle swarm optimization, Swarm Evol. Comput. 44 (2019) 349–364.
[44]
X. Zhang, X. Wang, Q. Kang, J. Cheng, Differential mutation and novel social learning particle swarm optimization algorithm, Inform. Sci. 480 (2019) 109–129.
[45]
Y. Shi, R.C. Eberhart, Empirical study of particle swarm optimization, Evolutionary computation, CEC99, Proceeding of the 1999 Congress 1 (1999) 320–324.
[46]
Y.-J. Gong, J.-J. Li, Y. Zhou, Y. Li, H.S.-H. Chung, Y.-H. Shi, J. Zhang, Genetic learning particle swarm optimization, IEEE Trans. Cybern. 46 (10) (2016) 2277–2290.
[47]
Y. Wang, Z. Cai, Q. Zhang, Differential evolution with composite trial vector generation strategies and control parameters, IEEE Trans. Evol. Comput. 15 (1) (2011) 55–66.

Cited By

View all
  • (2024)EAOJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23680446:2(4361-4380)Online publication date: 14-Feb-2024
  • (2024)Heterogeneous teaching–learning based optimization with local search for the covering delivering problem in last mile deliveryExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124176252:PAOnline publication date: 24-Jul-2024
  • (2024)A modified hybrid particle swarm optimization based on comprehensive learning and dynamic multi-swarm strategySoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-023-09332-028:5(3879-3903)Online publication date: 1-Mar-2024
  • Show More Cited By

Index Terms

  1. Self-Adaptive two roles hybrid learning strategies-based particle swarm optimization
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image Information Sciences: an International Journal
        Information Sciences: an International Journal  Volume 578, Issue C
        Nov 2021
        950 pages

        Publisher

        Elsevier Science Inc.

        United States

        Publication History

        Published: 01 November 2021

        Author Tags

        1. Particle swarm optimization
        2. Comprehensive learning
        3. Elitism learning
        4. Self-adaptive parameters updating

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 11 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)EAOJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23680446:2(4361-4380)Online publication date: 14-Feb-2024
        • (2024)Heterogeneous teaching–learning based optimization with local search for the covering delivering problem in last mile deliveryExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124176252:PAOnline publication date: 24-Jul-2024
        • (2024)A modified hybrid particle swarm optimization based on comprehensive learning and dynamic multi-swarm strategySoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-023-09332-028:5(3879-3903)Online publication date: 1-Mar-2024
        • (2024)Multi-threshold image segmentation algorithm based on Aquila optimizationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02993-w40:4(2905-2932)Online publication date: 1-Apr-2024
        • (2023)MetaBoxProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3666596(10775-10795)Online publication date: 10-Dec-2023
        • (2023)Multi-modal multi-objective particle swarm optimization with self-adjusting strategyInformation Sciences: an International Journal10.1016/j.ins.2023.02.019629:C(580-598)Online publication date: 1-Jun-2023
        • (2022)Strategy dynamics particle swarm optimizerInformation Sciences: an International Journal10.1016/j.ins.2021.10.028582:C(665-703)Online publication date: 1-Jan-2022

        View Options

        View options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media