The genetic algorithm is a general purpose, population-based search algorithm in which the individuals in the population represent samples from the set of all possibilities, whether they are solutions in a problem space, strategies for a game, rules in classifier systems, or arguments for problems in function optimization. The individuals evolve over time to form even better individuals by sharing and mixing their information about the space.
This dissertation proposes a parallelized version of a genetic algorithm called the distributed genetic algorithm, which can achieve near-linear speedup over the traditional version of the algorithm. This algorithm divides the large population into many equal-sized small subpopulations and runs the genetic algorithm on each subpopulation independently. Each subpopulation periodically selects some individuals and exchanges them with other subpopulations; the process known as migration.
The functions used to evaluate the performance of the distributed genetic algorithm and the traditional algorithm are called Walsh polynomials, which are based on Walsh functions. Walsh polynomials can be categorized into classes of functions with each class having a different degree of difficulty. By generating a large number of instances of the various classes, the performance difference between the distributed and traditional genetic algorithms can be analyzed statistically.
The first part of this dissertation examines the partitioned genetic algorithm, a version of the distributed genetic algorithm with no migration. The experiments on four different classes of Walsh polynomials show that the partitioned algorithm consistently outperforms the traditional algorithm as a function optimizer. This is because the physical subdivision of the population will allow each subpopulation to explore the space independently. Also, good individuals are more likely to be recognized in a smaller subpopulation than they would be in a large, diverse population. The second part of this research examines the effects of migration on the performance of the distributed genetic algorithm. The experiments show that with a moderate migration rate the distributed genetic algorithm finds better individuals than the traditional algorithm while maintaining a high overall fitness of the population.
Finally, this dissertation also discusses the issue of balancing exploration against exploitation in the distributed genetic algorithm, by allowing different subpopulations to run with different parameters, so that some subpopulations can emphasize exploration while others emphasize exploitation. The distributed algorithm is shown to be more robust than the traditional version: even when each subpopulation runs with different combinations of crossover and mutation rates, the distributed algorithm performs better than the traditional one.
Cited By
- Hasenöhrl V and Sutton A On the runtime dynamics of the compact genetic algorithm on jump functions Proceedings of the Genetic and Evolutionary Computation Conference, (967-974)
- Silva F, Duarte M, Correia L, Oliveira S and Christensen A (2016). Open issues in evolutionary robotics, Evolutionary Computation, 24:2, (205-236), Online publication date: 1-Jun-2016.
- Manukyan N, Eppstein M and Buzas J NM landscapes Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation, (203-204)
- Patton R, Beckerman B and Potok T Analysis of mammography reports using maximum variation sampling Proceedings of the 10th annual conference companion on Genetic and evolutionary computation, (2061-2064)
- Patton R and Potok T Characterizing large text corpora using a maximum variation sampling genetic algorithm Proceedings of the 8th annual conference on Genetic and evolutionary computation, (1877-1878)
- Haynes T Distributing collective adaptation via message passing Proceedings of the 1999 ACM symposium on Applied computing, (501-505)
- Kuo T and Hwang S (1997). Using Disruptive Selection to Maintain Diversity in GeneticAlgorithms, Applied Intelligence, 7:3, (257-267), Online publication date: 1-Jul-1997.
- Smith R, Forrest S and Perelson A (1993). Searching for diverse, cooperative populations with genetic algorithms, Evolutionary Computation, 1:2, (127-149), Online publication date: 1-Jun-1993.
- Humphrey S and Krovetz B (1990). Selected M-Related Dissertations Bibliography, ACM SIGART Bulletin, 1:3, (51-58), Online publication date: 1-Oct-1990.
Recommendations
Gradual distributed real-coded genetic algorithms
A major problem in the use of genetic algorithms is premature convergence. One approach for dealing with this problem is the distributed genetic algorithm model. Its basic idea is to keep, in parallel, several subpopulations that are processed by ...
An improved class of real-coded Genetic Algorithms for numerical optimization
Over the last few decades, many improved Evolutionary Algorithms (EAs) have been proposed to tackle different types of optimization problems. Genetic Algorithm (GA) among other canonical algorithms have not shown consistent performance over a range of ...
Niche Genetic Algorithm Based on Sexual Reproduction and Multimodal Function Optimization Problem
In this paper, a genetic algorithm with sexual reproduction and niche selection technology is proposed. Simple genetic algorithm has been successfully applied to many evolutionary optimization problems. But there is a problem of premature convergence for ...