[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2001576.2001781acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

A novel generative encoding for evolving modular, regular and scalable networks

Published: 12 July 2011 Publication History

Abstract

In this paper we introduce the Developmental Symbolic Encoding (DSE), a new generative encoding for evolving networks (e.g. neural or boolean). DSE combines elements of two powerful generative encodings, Cellular Encoding and HyperNEAT, in order to evolve networks that are modular, regular, scale-free, and scalable. Generating networks with these properties is important because they can enhance performance and evolvability. We test DSE's ability to generate scale-free and modular networks by explicitly rewarding these properties and seeing whether evolution can produce networks that possess them. We compare the networks DSE evolves to those of HyperNEAT. The results show that both encodings can produce scale-free networks, although DSE performs slightly, but significantly, better on this objective. DSE networks are far more modular than HyperNEAT networks. Both encodings produce regular networks. We further demonstrate that individual DSE genomes during development can scale up a network pattern to accommodate different numbers of inputs. We also compare DSE to HyperNEAT on a pattern recognition problem. DSE significantly outperforms HyperNEAT, suggesting that its potential lay not just in the properties of the networks it produces, but also because it can compete with leading encodings at solving challenging problems. These preliminary results imply that DSE is an interesting new encoding worthy of additional study. The results also raise questions about which network properties are more likely to be produced by different types of generative encodings.

References

[1]
A. Barabási. Scale-Free Networks: A Decade and Beyond. Science, 1173299(412):325, 2009.
[2]
J. Clune, B. E. Beckmann, P. K. McKinley, and C. Ofria. Investigating whether HyperNEAT produces modular neural networks. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 635--642. ACM, 2010.
[3]
J. Clune, K. Stanley, R. Pennock, and C. Ofria. On the performance of indirect encoding across the continuum of regularity. IEEE Transactions on Evolutionary Computation, To appear, 2011.
[4]
O. J. Coleman. Evolving neural networks for visual processing. B.S. Thesis. U. New South Wales, 2010.
[5]
F. Gruau. Neural Network Synthesis using Cellular Encoding and the Genetic Algorithm. PhD thesis, Ecole Normale Supérieure de Lyon, France, 1994.
[6]
S. Harding and W. Banzhaf. Artificial development. Organic Computing, pages 201--219, 2008.
[7]
S. Harding, J. Miller, and W. Banzhaf. Self modifying cartesian genetic programming: Parity. In Evolutionary Computation, 2009. CEC'09. IEEE Congress on, pages 285--292. IEEE, 2009.
[8]
G. Hornby, H. Lipson, and J. Pollack. Generative representations for the automated design of modular physical robots. IEEE Transactions on Robotics and Automation, 19(4):703--719, 2003.
[9]
G. Hornby and J. Pollack. Creating high-level components with a generative representation for body-brain evolution. Artificial Life, 8(3), 2002.
[10]
G. S. Hornby. Measuring, enabling and comparing modularity, regularity and hierarchy in evolutionary design. In Proceedings of the Genetic and Evolutionary Computation Conference. ACM, 2005.
[11]
N. Kashtan and U. Alon. Spontaneous evolution of modularity and network motifs. Proc. Natl. Acad. Sci. U.S.A., 102(39):13773, 2005.
[12]
H. Lipson. Principles of modularity, regularity, and hierarchy for scalable systems. Journal of Biological Physics and Chemistry, 7(4):125, 2007.
[13]
M. E. J. Newman. Fast algorithm for detecting community structure in networks. Physical Review E, 69(6):066133, 2004.
[14]
M. E. J. Newman and M. Girvan. Finding and evaluating community structure in networks. Physical review E, 69(2):26113, 2004.
[15]
R. Poli, W. Langdon, and N. McPhee. A Field Guide to Genetic Programming. Lulu Press, 2008.
[16]
K. Stanley, D. D'Ambrosio, and J. Gauci. A hypercube-based encoding for evolving large-scale neural networks. Artificial Life, 15(2):185--212, 2009.
[17]
K. Stanley and R. Miikkulainen. A taxonomy for artificial embryogeny. Artificial Life, 9(2), 2003.
[18]
G. Striedter. Principles of brain evolution. Sinauer Associates Sunderland, MA, 2005.
[19]
M. Suchorzewski. Evolving scalable and modular adaptive networks with Developmental Symbolic Encoding. Evolutionary Intelligence, To appear, 2011.
[20]
P. Verbancsics and K. Stanley. Constraining Connectivity to Encourage Modularity in HyperNEAT. U. Central Florida Tech Report, 2010.

Cited By

View all
  • (2023)Towards Understanding the Link Between Modularity and Performance in Neural Networks for Reinforcement Learning2023 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN54540.2023.10191234(1-7)Online publication date: 18-Jun-2023
  • (2021)Evolutionary Large-Scale Multi-Objective Optimization: A SurveyACM Computing Surveys10.1145/347097154:8(1-34)Online publication date: 4-Oct-2021
  • (2019)Evolving Programs to Build Artificial Neural NetworksFrom Astrophysics to Unconventional Computation10.1007/978-3-030-15792-0_2(23-71)Online publication date: 17-Apr-2019
  • Show More Cited By

Index Terms

  1. A novel generative encoding for evolving modular, regular and scalable networks

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '11: Proceedings of the 13th annual conference on Genetic and evolutionary computation
    July 2011
    2140 pages
    ISBN:9781450305570
    DOI:10.1145/2001576
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 July 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. generative and developmental representations
    2. indirect encoding
    3. modularity
    4. networks
    5. neuroevolution
    6. regularity
    7. scalability
    8. scale-free

    Qualifiers

    • Research-article

    Conference

    GECCO '11
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 13 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Towards Understanding the Link Between Modularity and Performance in Neural Networks for Reinforcement Learning2023 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN54540.2023.10191234(1-7)Online publication date: 18-Jun-2023
    • (2021)Evolutionary Large-Scale Multi-Objective Optimization: A SurveyACM Computing Surveys10.1145/347097154:8(1-34)Online publication date: 4-Oct-2021
    • (2019)Evolving Programs to Build Artificial Neural NetworksFrom Astrophysics to Unconventional Computation10.1007/978-3-030-15792-0_2(23-71)Online publication date: 17-Apr-2019
    • (2019)Evolving Developmental Programs That Build Neural Networks for Solving Multiple ProblemsGenetic Programming Theory and Practice XVI10.1007/978-3-030-04735-1_8(137-178)Online publication date: 24-Jan-2019
    • (2016)Solving multiple isolated, interleaved, and blended tasks through modular neuroevolutionEvolutionary Computation10.1162/EVCO_a_0018124:3(459-490)Online publication date: 1-Sep-2016
    • (2014)Evolving neural networks that are both modular and regularProceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation10.1145/2576768.2598232(697-704)Online publication date: 12-Jul-2014
    • (2014)Artificial Neurogenesis: An Introduction and Selective ReviewGrowing Adaptive Machines10.1007/978-3-642-55337-0_1(1-60)Online publication date: 5-Jun-2014
    • (2013)Critical factors in the performance of hyperNEATProceedings of the 15th annual conference on Genetic and evolutionary computation10.1145/2463372.2463460(759-766)Online publication date: 6-Jul-2013
    • (2013)Graph grammars for evolutionary 3D designGenetic Programming and Evolvable Machines10.1007/s10710-013-9190-014:3(369-393)Online publication date: 1-Sep-2013

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media