[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3638530.3664065acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
abstract

Runtime Analysis of the (μ + 1) GA: Provable Speed-Ups from Strong Drift towards Diverse Populations

Published: 01 August 2024 Publication History

Abstract

Most evolutionary algorithms used in practice heavily employ crossover. In contrast, the rigorous understanding of how crossover is beneficial is largely lagging behind. In this work, we make a considerable step forward by analyzing the population dynamics of the (μ + 1) genetic algorithm when optimizing the Jump benchmark. We observe (and prove via mathematical means) that once the population contains two different individuals on the local optimum, the diversity in the population increases in expectation. From this drift towards more diverse states, we show that a diversity suitable for crossover to be effective is reached quickly and, more importantly, then persists for a time that is at least exponential in the population size μ. This drastically improves over the previously best known guarantee, which is only quadratic in μ.
Our new understanding of the population dynamics easily gives stronger performance guarantees. In particular, we derive that population sizes logarithmic in the problem size n already suffice to gain an Ω(n)-factor runtime improvement from crossover (previous works achieved comparable bounds only with μ = Θ(n) or via a non-standard mutation rate).
This paper for the hot-off-the-press track at GECCO 2024 summarizes the work Benjamin Doerr, Aymen Echarghaoui, Mohammed Jamal, and Martin S. Krejca: Runtime analysis of the (μ + 1) GA: Provable speed-ups from strong drift towards diverse populations. Conference on Artificial Intelligence, AAAI 2024. AAAI Press, 20683--20691. DOI: 10.1609/aaai.v38i18.30055 [4].

References

[1]
Anne Auger and Benjamin Doerr (Eds.). 2011. Theory of Randomized Search Heuristics. World Scientific Publishing.
[2]
Duc-Cuong Dang, Tobias Friedrich, Timo Kötzing, Martin S. Krejca, Per Kristian Lehre, Pietro S. Oliveto, Dirk Sudholt, and Andrew M. Sutton. 2018. Escaping local optima using crossover with emergent diversity. IEEE Transactions on Evolutionary Computation 22 (2018), 484--497.
[3]
Duc-Cuong Dang, Andre Opris, Bahare Salehi, and Dirk Sudholt. 2023. A proof that using crossover can guarantee exponential speed-ups in evolutionary multi-objective optimisation. In Conference on Artificial Intelligence, AAAI 2023. AAAI Press, 12390--12398.
[4]
Benjamin Doerr, Aymen Echarghaoui, Mohammed Jamal, and Martin S. Krejca. 2024. Runtime Analysis of the (μ + 1) GA: Provable Speed-Ups from Strong Drift towards Diverse Populations. In Conference on Artificial Intelligence, AAAI 2024. AAAI Press, 20683--20691.
[5]
Benjamin Doerr, Edda Happ, and Christian Klein. 2012. Crossover can provably be useful in evolutionary computation. Theoretical Computer Science 425 (2012), 17--33.
[6]
Benjamin Doerr and Frank Neumann (Eds.). 2020. Theory of Evolutionary Computation---Recent Developments in Discrete Optimization. Springer.
[7]
John H. Holland. 1975. Adaptation in Natural and Artificial Systems. University of Michigan Press.
[8]
Thomas Jansen. 2013. Analyzing Evolutionary Algorithms - The Computer Science Perspective. Springer.
[9]
Thomas Jansen and Ingo Wegener. 2002. The analysis of evolutionary algorithms - a proof that crossover really can help. Algorithmica 34 (2002), 47--66.
[10]
Melanie Mitchell, John H. Holland, and Stephanie Forrest. 1993. When will a genetic algorithm outperform hill climbing. In Advances in Neural Information Processing Systems, NIPS 1993. Morgan Kaufmann, 51--58.
[11]
Frank Neumann and Carsten Witt. 2010. Bioinspired Computation in Combinatorial Optimization - Algorithms and Their Computational Complexity. Springer.
[12]
Andre Opris, Johannes Lengler, and Dirk Sudholt. 2024. A Tight O(4k/pc) Runtime Bound for a (μ + 1) GA on Jumpk for Realistic Crossover Probabilities. CoRR abs/2404.07061 (2024). To be published at GECCO 2024.
[13]
Zhi-Hua Zhou, Yang Yu, and Chao Qian. 2019. Evolutionary Learning: Advances in Theories and Algorithms. Springer.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '24 Companion: Proceedings of the Genetic and Evolutionary Computation Conference Companion
July 2024
2187 pages
ISBN:9798400704956
DOI:10.1145/3638530
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2024

Check for updates

Author Tags

  1. theory
  2. runtime analysis
  3. genetic algorithm
  4. crossover
  5. jump

Qualifiers

  • Abstract

Funding Sources

  • FMJH Program PGMO

Conference

GECCO '24 Companion
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 12
    Total Downloads
  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)1
Reflects downloads up to 18 Dec 2024

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media