[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3583131.3590383acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Runtime Analysis of Quality Diversity Algorithms

Published: 12 July 2023 Publication History

Abstract

Quality diversity (QD) is a branch of evolutionary computation that gained increasing interest in recent years. The Map-Elites QD approach defines a feature space, i.e., a partition of the search space, and stores the best solution for each cell of this space. We study a simple QD algorithm in the context of pseudo-Boolean optimisation on the "number of ones" feature space, where the ith cell stores the best solution amongst those with a number of ones in [(i - 1)k, ik - 1]. Here k is a granularity parameter 1 ≤ kn+1. We give a tight bound on the expected time until all cells are covered for arbitrary fitness functions and for all k and analyse the expected optimisation time of QD on OneMax and other problems whose structure aligns favourably with the feature space. On combinatorial problems we show that QD finds a (1 - 1/e)-approximation when maximising any monotone sub-modular function with a single uniform cardinality constraint efficiently. Defining the feature space as the number of connected components of a connected graph, we show that QD finds a minimum spanning tree in expected polynomial time.

References

[1]
Jakob Bossek and Frank Neumann. 2022. Exploring the Feature Space of TSP Instances Using Quality Diversity. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '22). Association for Computing Machinery, New York, NY, USA, 186--194.
[2]
Konstantinos Chatzilygeroudis, Antoine Cully, Vassilis Vassiliades, and Jean-Baptiste Mouret. 2021. Quality-Diversity Optimization: A Novel Branch of Stochastic Optimization. In Black Box Optimization, Machine Learning, and No-Free Lunch Theorems, Panos M. Pardalos, Varvara Rasskazova, and Michael N. Vrahatis (Eds.). Springer International Publishing, Cham, 109--135.
[3]
Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein. 2009. Introduction to Algorithms, Third Edition (3rd ed.). The MIT Press.
[4]
Edgar Covantes Osuna, Wanru Gao, Frank Neumann, and Dirk Sudholt. 2020. Design and Analysis of Diversity-Based Parent Selection Schemes for Speeding Up Evolutionary Multi-objective Optimisation. Theoretical Computer Science 832 (2020), 123--142.
[5]
A. Cully and J. B. Mouret. 2016. Evolving a Behavioral Repertoire for a Walking Robot. Evolutionary Computation 24, 1 (2016), 59--88.
[6]
Kalyanmoy Deb. 2012. Optimization for Engineering Design - Algorithms and Examples, Second Edition. PHI Learning Private Limited.
[7]
Anh Viet Do, Mingyu Guo, Aneta Neumann, and Frank Neumann. 2021. Analysis of Evolutionary Diversity Optimisation for Permutation Problems. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '21). Association for Computing Machinery, New York, NY, USA, 574--582.
[8]
Benjamin Doerr. 2020. Theory of Evolutionary Computation: Recent Developments in Discrete Optimization. Springer, Chapter Probabilistic Tools for the Analysis of Randomized Optimization Heuristics, 1--87.
[9]
Benjamin Doerr, Thomas Jansen, Dirk Sudholt, Carola Winzen, and Christine Zarges. 2013. Mutation Rate Matters Even When Optimizing Monotonic Functions. Evolutionary Computation 21, 1 (2013), 1--21.
[10]
Benjamin Doerr, Amirhossein Rajabi, and Carsten Witt. 2022. Simulated annealing is a polynomial-time approximation scheme for the minimum spanning tree problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '22), Jonathan E. Fieldsend and Markus Wagner (Eds.). ACM, 1381--1389.
[11]
Stefan Droste, Thomas Jansen, and Ingo Wegener. 2002. On the analysis of the (1+1) evolutionary algorithm. Theoretical Computer Science 276, 1--2 (2002), 51--81.
[12]
Tobias Friedrich and Frank Neumann. 2014. Maximizing Submodular Functions under Matroid Constraints by Multi-objective Evolutionary Algorithms. In Parallel Problem Solving from Nature (PPSN '14), Thomas Bartz-Beielstein, Jürgen Branke, Bogdan Filipič, and Jim Smith (Eds.). Springer International Publishing, Cham, 922--931.
[13]
Tobias Friedrich and Frank Neumann. 2015. Maximizing Submodular Functions under Matroid Constraints by Evolutionary Algorithms. Evolutionary Computation 23, 4 (12 2015), 543--558.
[14]
Tobias Friedrich, Pietro S. Oliveto, Dirk Sudholt, and Carsten Witt. 2009. Analysis of Diversity-Preserving Mechanisms for Global Exploration*. Evolutionary Computation 17, 4 (2009), 455--476.
[15]
Jens Jägersküpper and Tobias Storch. 2007. When the Plus Strategy Outperforms the Comma Strategy and When Not. In Proceedings of the IEEE Symposium on Foundations of Computational Intelligence (FOCI). IEEE, 25--32.
[16]
Marc Kaufmann, Maxime Larcher, Johannes Lengler, and Xun Zou. 2022. Self-adjusting Population Sizes for the (1, Λ)-EA on Monotone Functions. In Parallel Problem Solving from Nature (PPSN '22) (Lecture Notes in Computer Science, Vol. 13399), Günter Rudolph, Anna V. Kononova, Hernán E. Aguirre, Pascal Kerschke, Gabriela Ochoa, and Tea Tusar (Eds.). Springer, 569--585.
[17]
Johannes Lengler. 2020. A General Dichotomy of Evolutionary Algorithms on Monotone Functions. IEEE Transactions on Evolutionary Computation 24, 6 (2020), 995--1009.
[18]
Johannes Lengler and Angelika Steger. 2018. Drift Analysis and Evolutionary Algorithms Revisited. Combinatorics, Probability & Computing 27, 4 (2018), 643--666.
[19]
Johannes Lengler and Xun Zou. 2021. Exponential slowdown for larger populations: The (μ+1)-EA on monotone functions. Theoretical Computer Science 875 (2021), 28--51.
[20]
Jean-Baptiste Mouret and J. Clune. 2015. Illuminating Search Spaces by Mapping Elites. ArXiv (2015).
[21]
G. L. Nemhauser, L. A. Wolsey, and M. L. Fisher. 1978. An Analysis of Approximations for Maximizing Submodular Set Functions-I. Math. Program. 14, 1 (1978), 265--294.
[22]
Frank Neumann and Ingo Wegener. 2005. Minimum Spanning Trees Made Easier via Multi-Objective Optimization. In Proceedings of the Conference on Genetic and Evolutionary Computation (GECCO '05). ACM, New York, NY, USA, 763--769.
[23]
Frank Neumann and Ingo Wegener. 2006. Minimum Spanning Trees Made Easier Via Multi-Objective Optimization. Natural Computing 5, 3 (2006), 305--319.
[24]
Frank Neumann and Carsten Witt. 2010. Ant Colony Optimization and the minimum spanning tree problem. Theoretical Computer Science 411, 25 (2010), 2406--2413.
[25]
F. Neumann and C. Witt. 2010. Bioinspired Computation in Combinatorial Optimization: Algorithms and Their Computational Complexity. Springer Berlin Heidelberg.
[26]
Adel Nikfarjam, Aneta Neumann, and Frank Neumann. 2022. On the Use of Quality Diversity Algorithms for the Traveling Thief Problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '22). Association for Computing Machinery, New York, NY, USA, 260--268.
[27]
Adel Nikfarjam, Anh Viet Do, and Frank Neumann. 2022. Analysis of Quality Diversity Algorithms for the Knapsack Problem. In Parallel Problem Solving from Nature (PPSN '22). Springer-Verlag, Berlin, Heidelberg, 413--427.
[28]
Mike Preuss. 2015. Multimodal Optimization by Means of Evolutionary Algorithms. Springer International Publishing, Cham.
[29]
Adam Prügel-Bennett. 2004. When a genetic algorithm outperforms hill-climbing. Theoretical Computer Science 320, 1 (2004), 135 -- 153.
[30]
Amirhossein Rajabi and Carsten Witt. 2021. Stagnation Detection in Highly Multimodal Fitness Landscapes. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '21). Association for Computing Machinery, New York, NY, USA, 1178--1186.
[31]
Tamara Ulrich and Lothar Thiele. 2011. Maximizing Population Diversity in Single-Objective Optimization. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '11). Association for Computing Machinery, New York, NY, USA, 641--648.
[32]
Ingo Wegener. 2005. Simulated annealing beats Metropolis in combinatorial optimization. In Proceedings of the 32nd International Colloquium on Automata, Languages and Programming (ICALP '05) (LNCS, Vol. 3580). 589--601.
[33]
Carsten Witt. 2013. Tight Bounds on the Optimization Time of a Randomized Search Heuristic on Linear Functions. Combinatorics, Probability & Computing 22, 2 (2013), 294--318.
[34]
Weijie Zheng, Yufei Liu, and Benjamin Doerr. 2022. A First Mathematical Runtime Analysis of the Non-dominated Sorting Genetic Algorithm II (NSGA-II). Proceedings of the AAAI Conference on Artificial Intelligence 36, 9 (2022), 10408--10416.

Cited By

View all
  • (2024)Guiding Quality Diversity on Monotone Submodular Functions: Customising the Feature Space by Adding Boolean ConjunctionsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654160(1614-1622)Online publication date: 14-Jul-2024
  • (2024)Runtime Analysis of Quality Diversity AlgorithmsAlgorithmica10.1007/s00453-024-01254-z86:10(3252-3283)Online publication date: 1-Oct-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '23: Proceedings of the Genetic and Evolutionary Computation Conference
July 2023
1667 pages
ISBN:9798400701191
DOI:10.1145/3583131
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 July 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. quality diversity
  2. runtime analysis

Qualifiers

  • Research-article

Conference

GECCO '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)1
Reflects downloads up to 18 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Guiding Quality Diversity on Monotone Submodular Functions: Customising the Feature Space by Adding Boolean ConjunctionsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654160(1614-1622)Online publication date: 14-Jul-2024
  • (2024)Runtime Analysis of Quality Diversity AlgorithmsAlgorithmica10.1007/s00453-024-01254-z86:10(3252-3283)Online publication date: 1-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media