[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Distributed Knowledge Transfer for Evolutionary Multitask Multimodal Optimization

Published: 03 July 2023 Publication History

Abstract

Evolutionary multitasking optimization (EMTO) is a paradigm that optimizes multiple tasks simultaneously to improve the overall performance of all tasks by seamlessly transferring useful knowledge among them. Although EMTO has received significant interest, rare studies consider handling tasks that are multimodal optimization problems (MMOPs) with multiple global optimal solutions. Due to the multiple different modalities of each task, a major challenge of solving multiple MMOPs is how to extract and transfer knowledge across modalities of different tasks. To this end, this article designs a distributed knowledge transfer-based evolutionary multitask multimodal optimization (EMTMO-DKT) approach for solving multiple MMOPs simultaneously by discovering and utilizing local knowledge across modalities of different tasks. Specifically, we first divide the population of each task into multiple subpopulations, where each subpopulation explores a modality. Then, we propose an evolution path-based similarity measurement to measure the local similarities between subpopulations of different tasks. Since the modalities can be locally similar across tasks, we develop a subpopulation cross matching strategy according to the obtained similarities to pair subpopulations of different tasks. In this stage, the successfully paired subpopulations are allowed to transfer knowledge. Finally, the knowledge transfer probability self-adjusting strategy is applied to each subpopulation to balance knowledge transfer and self-evolution, so as to improve search efficiency. In this article, a set of multitask multimodal optimization test problems are constructed to assess the efficacy of compared algorithms. Experimental results on both the benchmark functions and the real-world optimization problem demonstrate that the proposed algorithm can quickly locate more global optima in comparison with state-of-the-art EMTO and multimodal optimization algorithms.

References

[1]
T. Back, U. Hammel, and H.-P. Schwefel, “Evolutionary computation: Comments on the history and current state,” IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 3–17, Apr. 1997.
[2]
L. Feng, Y.-S. Ong, M.-H. Lim, and I. W. Tsang, “Memetic search with interdomain learning: A realization between CVRP and CARP,” IEEE Trans. Evol. Comput., vol. 19, no. 5, pp. 644–658, Oct. 2015.
[3]
K. C. Tan, Y. H. Chew, and L. H. Lee, “A hybrid multiobjective evolutionary algorithm for solving vehicle routing problem with time windows,” Comput. Optim. Appl., vol. 34, no. 1, pp. 115–151, 2006.
[4]
Z. Zhou, Y. S. Ong, P. B. Nair, A. J. Keane, and K. Y. Lum, “Combining global and local surrogate models to accelerate evolutionary optimization,” IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 37, no. 1, pp. 66–76, Jan. 2007.
[5]
Z. Pan, D. Lei, and L. Wang, “A bi-population evolutionary algorithm with feedback for energy-efficient fuzzy flexible job shop scheduling,” IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 52, no. 8, pp. 5295–5307, Aug. 2022.
[6]
Z. Luet al., “Multiobjective evolutionary design of deep convolutional neural networks for image classification,” IEEE Trans. Evol. Comput., vol. 25, no. 2, pp. 277–291, Apr. 2021.
[7]
Y. Sun, B. Xue, M. Zhang, G. G. Yen, and J. Lv, “Automatically designing CNN architectures using the genetic algorithm for image classification,” IEEE Trans. Cybern., vol. 50, no. 9, pp. 3840–3854, Sep. 2020.
[8]
K. C. Tan, L. Feng, and M. Jiang, “Evolutionary transfer optimization—A new frontier in evolutionary computation research,” IEEE Comput. Intell. Mag., vol. 16, no. 1, pp. 22–33, Feb. 2021.
[9]
X. Xueet al., “Evolutionary sequential transfer optimization for objective-heterogeneous problems,” IEEE Trans. Evol. Comput., vol. 26, no. 6, pp. 1424–1438, Dec. 2022.
[10]
C. Yang, J. Ding, Y. Jin, and T. Chai, “Offline data-driven multiobjective optimization: Knowledge transfer between surrogates and generation of final solutions,” IEEE Trans. Evol. Comput., vol. 24, no. 3, pp. 409–423, Jun. 2020.
[11]
A. Gupta, Y.-S. Ong, and L. Feng, “Multifactorial evolution: Toward evolutionary multitasking,” IEEE Trans. Evol. Comput., vol. 20, no. 3, pp. 343–357, Jun. 2016.
[12]
A. Gupta, Y.-S. Ong, L. Feng, and K. C. Tan, “Multiobjective multifactorial optimization in evolutionary multitasking,” IEEE Trans. Cybern., vol. 47, no. 7, pp. 1652–1665, Jul. 2017.
[13]
C. Yang, J. Ding, Y. Jin, C. Wang, and T. Chai, “Multitasking multiobjective evolutionary operational indices optimization of beneficiation processes,” IEEE Trans. Autom. Sci. Eng., vol. 16, no. 3, pp. 1046–1057, Jul. 2019.
[14]
F. Zhang, Y. Mei, S. Nguyen, K. C. Tan, and M. Zhang, “Task relatedness based multitask genetic programming for dynamic flexible job shop scheduling,” IEEE Trans. Evol. Comput., early access, Aug. 18, 2022. 10.1109/TEVC.2022.3199783.
[15]
L. Fenget al., “Explicit evolutionary multitasking for combinatorial optimization: A case study on capacitated vehicle routing problem,” IEEE Trans. Cybern., vol. 51, no. 6, pp. 3143–3156, Jun. 2021.
[16]
A. Gupta, L. Zhou, Y.-S. Ong, Z. Chen, and Y. Hou, “Half a dozen real-world applications of evolutionary multitasking, and more,” IEEE Comput. Intell. Mag., vol. 17, no. 2, pp. 49–66, May 2022.
[17]
W. Gao, G. G. Yen, and S. Liu, “A cluster-based differential evolution with self-adaptive strategy for multimodal optimization,” IEEE Trans. Cybern., vol. 44, no. 8, pp. 1314–1327, Aug. 2014.
[18]
K.-C. Wong, K.-S. Leung, and M.-H. Wong, “Protein structure prediction on a lattice model via multimodal optimization techniques,” in Proc. Genet. Evol. Comput. Conf. (GECCO), Portland, OR, USA, 2010, pp. 155–162.
[19]
E. Pérez, M. Posada, and F. Herrera, “Analysis of new niching genetic algorithms for finding multiple solutions in the job shop scheduling,” J. Intell. Manuf., vol. 23, no. 3, pp. 341–356, Jun. 2012.
[20]
S. Kamyab and M. Eftekhari, “Feature selection using multimodal optimization techniques,” Neurocomputing, vol. 171, pp. 586–597, Jan. 2016.
[21]
L. Zhou, L. Feng, J. Zhong, Z. Zhu, B. Da, and Z. Wu, “A study of similarity measure between tasks for multifactorial evolutionary algorithm,” in Proc. Genet. Evol. Comput. Conf. (GECCO), Kyoto, Japan, 2018, pp. 229–230.
[22]
B. Daet al., “Evolutionary multitasking for single-objective continuous optimization: Benchmark problems, performance metric, and baseline results,” 2016, arXiv:1706.03470.
[23]
H. Han, X. Bai, H. Han, Y. Hou, and J. Qiao, “Self-adjusting multitask particle swarm optimization,” IEEE Trans. Evol. Comput., vol. 26, no. 1, pp. 145–158, Feb. 2022.
[24]
X. Li, M. G. Epitropakis, K. Deb, and A. Engelbrecht, “Seeking multiple solutions: An updated survey on niching methods and their applications,” IEEE Trans. Evol. Comput., vol. 21, no. 4, pp. 518–538, Aug. 2017.
[25]
R. Thomsen, “Multimodal optimization using crowding-based differential evolution,” in Proc. IEEE Congr. Evol. Comput. (CEC), 2004, pp. 1382–1389.
[26]
X. Li, “Efficient differential evolution using speciation for multimodal function optimization,” in Proc. Genet. Evol. Comput. Conf. (GECCO), 2005, pp. 873–880.
[27]
B. Y. Qu, P. N. Suganthan, and J. J. Liang, “Differential evolution with neighborhood mutation for multimodal optimization,” IEEE Trans. Evol. Comput., vol. 16, no. 5, pp. 601–614, Oct. 2012.
[28]
C. Stoean, M. Preuss, R. Stoean, and D. Dumitrescu, “Multimodal optimization by means of a topological species conservation algorithm,” IEEE Trans. Evol. Comput., vol. 14, no. 6, pp. 842–864, Dec. 2010.
[29]
L. Li and K. Tang, “History-based topological speciation for multimodal optimization,” IEEE Trans. Evol. Comput., vol. 19, no. 1, pp. 136–150, Feb. 2015.
[30]
Z.-J. Wanget al., “Automatic niching differential evolution with contour prediction approach for multimodal optimization problems,” IEEE Trans. Evol. Comput., vol. 24, no. 1, pp. 114–128, Feb. 2020.
[31]
S. Biswas, S. Kundu, and S. Das, “Inducing niching behavior in differential evolution through local information sharing,” IEEE Trans. Evol. Comput., vol. 19, no. 2, pp. 246–263, Apr. 2015.
[32]
Z.-J. Wanget al., “Dual-strategy differential evolution with affinity propagation clustering for multimodal optimization problems,” IEEE Trans. Evol. Comput., vol. 22, no. 6, pp. 894–908, Dec. 2018.
[33]
Z. Wei, W. Gao, G. Li, and Q. Zhang, “A penalty-based differential evolution for multimodal optimization,” IEEE Trans. Cybern., vol. 52, no. 7, pp. 6024–6033, Jul. 2022.
[34]
X. Lin, W. Luo, and P. Xu, “Differential evolution for multimodal optimization with species by nearest-better clustering,” IEEE Trans. Cybern., vol. 51, no. 2, pp. 970–983, Feb. 2021.
[35]
Q. Yang, W.-N. Chen, Y. Li, C. L. Chen, X.-M. Xu, and J. Zhang, “Multimodal estimation of distribution algorithms,” IEEE Trans. Cybern., vol. 47, no. 3, pp. 636–650, Mar. 2017.
[36]
Q. Yanget al., “Adaptive multimodal continuous ant colony optimization,” IEEE Trans. Evol. Comput., vol. 21, no. 2, pp. 191–205, Apr. 2017.
[37]
Y. Wang, H.-X. Li, G. G. Yen, and W. Song, “MOMMOP: Multiobjective optimization for locating multiple optimal solutions of multimodal optimization problems,” IEEE Trans. Cybern., vol. 45, no. 4, pp. 830–843, Apr. 2015.
[38]
R. Cheng, M. Li, K. Li, and X. Yao, “Evolutionary multiobjective optimization-based multimodal optimization: Fitness landscape approximation and peak detection,” IEEE Trans. Evol. Comput., vol. 22, no. 5, pp. 692–706, Oct. 2018.
[39]
T. Wei, S. Wang, J. Zhong, D. Liu, and J. Zhang, “A review on evolutionary multi-task optimization: Trends and challenges,” IEEE Trans. Evol. Comput., vol. 26, no. 5, pp. 941–960, Oct. 2022.
[40]
K. K. Bali, Y.-S. Ong, A. Gupta, and P. S. Tan, “Multifactorial evolutionary algorithm with online transfer parameter estimation: MFEA-II,” IEEE Trans. Evol. Comput., vol. 24, no. 1, pp. 69–83, Feb. 2020.
[41]
X. Zheng, A. K. Qin, M. Gong, and D. Zhou, “Self-regulated evolutionary multitask optimization,” IEEE Trans. Evol. Comput., vol. 24, no. 1, pp. 16–28, Feb. 2020.
[42]
J. Ding, C. Yang, Y. Jin, and T. Chai, “Generalized multitasking for evolutionary optimization of expensive problems,” IEEE Trans. Evol. Comput., vol. 23, no. 1, pp. 44–58, Feb. 2019.
[43]
C. Yang, J. Ding, K. C. Tan, and Y. Jin, “Two-stage assortative mating for multi-objective multifactorial evolutionary optimization,” in Proc. IEEE 56th Annu. Conf. Decis. Control (CDC), 2017, pp. 76–81.
[44]
J. Yi, J. Bai, H. He, W. Zhou, and L. Yao, “A multifactorial evolutionary algorithm for multitasking under interval uncertainties,” IEEE Trans. Evol. Comput., vol. 24, no. 5, pp. 908–922, Oct. 2020.
[45]
J. Yi, W. Zhang, J. Bai, W. Zhou, and L. Yao, “Multifactorial evolutionary algorithm based on improved dynamical decomposition for many-objective optimization problems,” IEEE Trans. Evol. Comput., vol. 26, no. 2, pp. 334–348, Apr. 2022.
[46]
L. Fenget al., “Evolutionary multitasking via explicit autoencoding,” IEEE Trans. Cybern., vol. 49, no. 9, pp. 3457–3470, Sep. 2019.
[47]
L. Zhou, L. Feng, A. Gupta, and Y.-S. Ong, “Learnable evolutionary search across heterogeneous problems via kernelized autoencoding,” IEEE Trans. Evol. Comput., vol. 25, no. 3, pp. 567–581, Jun. 2021.
[48]
Z. Tang, M. Gong, Y. Wu, W. Liu, and Y. Xie, “Regularized evolutionary multitask optimization: Learning to intertask transfer in aligned subspace,” IEEE Trans. Evol. Comput., vol. 25, no. 2, pp. 262–276, Apr. 2021.
[49]
J. Lin, H.-L. Liu, B. Xue, M. Zhang, and F. Gu, “Multiobjective multitasking optimization based on incremental learning,” IEEE Trans. Evol. Comput., vol. 24, no. 5, pp. 824–838, Oct. 2020.
[50]
J.-Y. Li, Z.-H. Zhan, K. C. Tan, and J. Zhang, “A meta-knowledge transfer-based differential evolution for multitask optimization,” IEEE Trans. Evol. Comput., vol. 26, no. 4, pp. 719–734, Aug. 2022.
[51]
Z. Liang, X. Xu, L. Liu, Y. Tu, and Z. Zhu, “Evolutionary many-task optimization based on multisource knowledge transfer,” IEEE Trans. Evol. Comput., vol. 26, no. 2, pp. 319–333, Apr. 2022.
[52]
H. Xu, A. K. Qin, and S. Xia, “Evolutionary multitask optimization with adaptive knowledge transfer,” IEEE Trans. Evol. Comput., vol. 26, no. 2, pp. 290–303, Apr. 2022.
[53]
Y. Jiang, Z.-H. Zhan, K. C. Tan, and J. Zhang, “A bi-objective knowledge transfer framework for evolutionary many-task optimization,” IEEE Trans. Evol. Comput., early access, Sep. 29, 2022. 10.1109/TEVC.2022.3210783.
[54]
H. T. T. Binh, L. V. Cuong, T. B. Thang, and N. H. Long, “Ensemble multifactorial evolution with biased skill-factor inheritance for many-task optimization,” IEEE Trans. Evol. Comput., early access, Dec. 12, 2022. 10.1109/TEVC.2022.3227120.
[55]
X. Li, A. Engelbrecht, and M. G. Epitropakis, “Benchmark functions for CEC’2013 special session and competition on niching methods for multimodal function optimization,” Evol. Comput. Mach. Learn. Group, RMIT Univ., Melbourne, VIC, Australia, Rep., 2013.
[56]
A. Gretton, K. Borgwardt, M. Rasch, B. Schölkopf, and A. Smola, “A kernel method for the two-sample-problem,” in Proc. NIPS, 2006, pp. 1137–1144.
[57]
H. Yan, Y. Ding, P. Li, Q. Wang, Y. Xu, and W. Zuo, “Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2017, pp. 2272–2281.
[58]
Y. Chen, J. Zhong, L. Feng, and J. Zhang, “An adaptive archive-based evolutionary framework for many-task optimization,” IEEE Trans. Emerg. Topics Comput. Intell., vol. 4, no. 3, pp. 369–384, Jun. 2020.
[59]
J. Zhang, W. Zhou, X. Chen, W. Yao, and L. Cao, “Multisource selective transfer framework in multiobjective optimization problems,” IEEE Trans. Evol. Comput., vol. 24, no. 3, pp. 424–438, Jun. 2020.
[60]
B.-Y. Qu and P. N. Suganthan, “Novel multimodal problems and differential evolution with ensemble of restricted tournament selection,” in Proc. IEEE Congr. Evol. Comput. (CEC), 2010, pp. 1–7.
[61]
L. M. Ochoa-Estopier, M. Jobson, and R. Smith, “Operational optimization of crude oil distillation systems using artificial neural networks,” Comput. Chem. Eng., vol. 59, pp. 178–185, Dec. 2013.
[62]
M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm for discovering clusters in large spatial databases with noise,” in Proc. 2nd Int. Conf. Knowl. Disc. Data Min., 1996, pp. 226–231.

Index Terms

  1. Distributed Knowledge Transfer for Evolutionary Multitask Multimodal Optimization
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image IEEE Transactions on Evolutionary Computation
    IEEE Transactions on Evolutionary Computation  Volume 28, Issue 4
    Aug. 2024
    343 pages

    Publisher

    IEEE Press

    Publication History

    Published: 03 July 2023

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 0
      Total Downloads
    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 12 Dec 2024

    Other Metrics

    Citations

    View Options

    View options

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media