[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3321707.3321838acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

The efficiency threshold for the offspring population size of the (µ, λ) EA

Published: 13 July 2019 Publication History

Abstract

Understanding when evolutionary algorithms are efficient or not, and how they efficiently solve problems, is one of the central research tasks in evolutionary computation. In this work, we make progress in understanding the interplay between parent and offspring population size of the (µ, λ) EA. Previous works, roughly speaking, indicate that for λ ≥ (1 + ε), this EA easily optimizes the OneMax function, whereas an offspring population size λ ≤ (1 - ε) leads to an exponential runtime.
Motivated also by the observation that in the efficient regime the (µ, λ) EA loses its ability to escape local optima, we take a closer look into this phase transition. Among other results, we show that when µn1/2-c for any constant c > 0, then for any λ we have a super-polynomial runtime. However, if µn2/3+c, then for any λ, the runtime is polynomial. For the latter result we observe that the (µ, λ) EA profits from better individuals also because these, by creating slightly worse offspring, stabilize slightly sub-optimal sub-populations. While these first results close to the phase transition do not yet give a complete picture, they indicate that the boundary between efficient and super-polynomial is not just the line λ = , and that the reasons for efficiency or not are more complex than what was known so far.

References

[1]
Denis Antipov, Benjamin Doerr, Jiefeng Fang, and Tangi Hetet. 2018. Runtime analysis for the (µ + λ) EA optimizing OneMax. In Genetic and Evolutionary Computation Conference, GECCO 2018. ACM, 1459--1466.
[2]
Denis Antipov, Benjamin Doerr, and Quentin Yang. 2019. The efficiency threshold for the offspring population size of the (µ, λ) EA. arXiv e-prints arXiv:1904.06981 (2019).
[3]
Anne Auger and Benjamin Doerr (Eds.). 2011. Theory of Randomized Search Heuristics. World Scientific Publishing.
[4]
Dogan Corus, Duc-Cuong Dang, Anton V. Eremeev, and Per Kristian Lehre. 2018. Level-based analysis of genetic algorithms and other search processes. IEEE Transactions on Evolutionary Computation 22 (2018), 707--719.
[5]
Duc-Cuong Dang and Per Kristian Lehre. 2016. Runtime analysis of non-elitist populations: from classical optimisation to partial information. Algorithmica 75 (2016), 428--461.
[6]
C.S. Davis. 1978. Rational approximations to e. Journal of the Australian Mathematical Society 25 (1978), 497--502.
[7]
Benjamin Doerr. 2018. Better runtime guarantees via stochastic domination. In Evolutionary Computation in Combinatorial Optimization, EvoCOP 2018.
[8]
Benjamin Doerr and Timo Kötzing. 2019. Multiplicative up-drift. In Genetic and Evolutionary Computation Conference, GECCO 2019. ACM. To appear.
[9]
Bruce Hajek. 1982. Hitting-time and occupation-time bounds implied by drift analysis with applications. Advances in Applied Probability 13 (1982), 502--525.
[10]
Jun He and Xin Yao. 2001. Drift analysis and average time complexity of evolutionary algorithms. Artificial Intelligence 127 (2001), 51--81.
[11]
Jens Jägersküpper and Tobias Storch. 2007. When the plus strategy outperforms the comma strategy and when not. In Symposium on Foundations of Computational Intelligence, SSCI2007. IEEE, 25--32.
[12]
Thomas Jansen. 2013. Analyzing Evolutionary Algorithms - The Computer Science Perspective. Springer.
[13]
Per Kristian Lehre. 2010. Negative drift in populations. In Parallel Problem Solving from Nature, PPSN 2010. Springer, 244--253.
[14]
Per Kristian Lehre. 2011. Fitness-levels for non-elitist populations. In Genetic and Evolutionary Computation Conference, GECCO 2011. ACM, 2075--2082.
[15]
Frank Neumann, Pietro Simone Oliveto, and Carsten Witt. 2009. Theoretical analysis of fitness-proportional selection: landscapes and efficiency. In Genetic and Evolutionary Computation Conference, GECCO 2009. ACM, 835--842.
[16]
Frank Neumann and Carsten Witt. 2010. Bioinspired Computation in Combinatorial Optimization - Algorithms and Their Computational Complexity. Springer.
[17]
Gabriela Ochoa, Inman Harvey, and Hilary Buxton. 1999. Error thresholds and their relation to optimal mutation rates. In Advances in Artificial Life. Springer Berlin Heidelberg, 54--63.
[18]
Pietro Simone Oliveto and Carsten Witt. 2012. Erratum: simplified drift analysis for proving lower bounds in evolutionary computation. arXiv e-prints arXiv:1211.7184 (2012).
[19]
Pietro Simone Oliveto and Carsten Witt. 2015. Improved time complexity analysis of the simple genetic algorithm. Theoretical Computer Science 605 (2015), 21--41.
[20]
Jonathan E. Rowe and Dirk Sudholt. 2014. The choice of the offspring population size in the (1, λ) evolutionary algorithm. Theoretical Computer Science 545 (2014), 20--38.
[21]
Carsten Witt. 2013. Tight bounds on the optimization time of a randomized search heuristic on linear functions. Combinatorics, Probability & Computing 22 (2013), 294--318.

Cited By

View all
  • (2024)A Gentle Introduction to Theory (for Non-Theoreticians)Proceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3638530.3648402(800-829)Online publication date: 14-Jul-2024
  • (2024)Plus Strategies are Exponentially Slower for Planted Optima of Random HeightProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654088(1587-1595)Online publication date: 14-Jul-2024
  • (2023)Evolutionary Algorithms for Parameter Optimization—Thirty Years LaterEvolutionary Computation10.1162/evco_a_0032531:2(81-122)Online publication date: 1-Jun-2023
  • Show More Cited By

Index Terms

  1. The efficiency threshold for the offspring population size of the (µ, λ) EA

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '19: Proceedings of the Genetic and Evolutionary Computation Conference
    July 2019
    1545 pages
    ISBN:9781450361118
    DOI:10.1145/3321707
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 July 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. populations
    2. runtime analysis
    3. theory

    Qualifiers

    • Research-article

    Funding Sources

    • Government of Russian Federation
    • Paris Ile de France Region

    Conference

    GECCO '19
    Sponsor:
    GECCO '19: Genetic and Evolutionary Computation Conference
    July 13 - 17, 2019
    Prague, Czech Republic

    Acceptance Rates

    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Gentle Introduction to Theory (for Non-Theoreticians)Proceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3638530.3648402(800-829)Online publication date: 14-Jul-2024
    • (2024)Plus Strategies are Exponentially Slower for Planted Optima of Random HeightProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654088(1587-1595)Online publication date: 14-Jul-2024
    • (2023)Evolutionary Algorithms for Parameter Optimization—Thirty Years LaterEvolutionary Computation10.1162/evco_a_0032531:2(81-122)Online publication date: 1-Jun-2023
    • (2023)A Gentle Introduction to Theory (for Non-Theoreticians)Proceedings of the Companion Conference on Genetic and Evolutionary Computation10.1145/3583133.3595042(946-975)Online publication date: 15-Jul-2023
    • (2023)Comma Selection Outperforms Plus Selection on OneMax with Randomly Planted OptimaProceedings of the Genetic and Evolutionary Computation Conference10.1145/3583131.3590488(1602-1610)Online publication date: 15-Jul-2023
    • (2023)OneMax Is Not the Easiest Function for Fitness ImprovementsEvolutionary Computation in Combinatorial Optimization10.1007/978-3-031-30035-6_11(162-178)Online publication date: 31-Mar-2023
    • (2022)A gentle introduction to theory (for non-theoreticians)Proceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3533628(890-921)Online publication date: 9-Jul-2022
    • (2022)The (1 + (λ, λ)) global SEMO algorithmProceedings of the Genetic and Evolutionary Computation Conference10.1145/3512290.3528868(520-528)Online publication date: 8-Jul-2022
    • (2022)Does Comma Selection Help to Cope with Local Optima?Algorithmica10.1007/s00453-021-00896-784:6(1659-1693)Online publication date: 10-Jan-2022
    • (2022)Two-Dimensional Drift Analysis:Parallel Problem Solving from Nature – PPSN XVII10.1007/978-3-031-14721-0_43(612-625)Online publication date: 15-Aug-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media