Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. Part I: Basic properties of selection and mutation
- 1 January 1994
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 5 (1) , 102-119
- https://doi.org/10.1109/72.265965
Abstract
This paper aims at establishing fundamental theoretical properties for a class of ''genetic algorithms'' in continuous space (GACS). The algorithms employ operators such as selection, crossover, and mutation in the framework of a multidimensional Euclidean space. The paper is divided into two parts. The first part concentrates on the basic properties associated with the selection and mutation operators. Recursive formulae for the GACS in the general infinite population case are derived and their validity is rigorously proven. A convergence analysis is presented for the classical case of a quadratic cost function. It is shown how the increment of the population mean is driven by its own diversity and follows a modified Newton's search. Sufficient conditions for monotonic increase of the population mean fitness are derived for a more general class of fitness functions satisfying a Lipschitz condition. The diversification role of the crossover operator is analyzed in Part II [1]. The treatment adds much light to the understanding of the underlying mechanism of evolution-like algorithms.Keywords
This publication has 37 references indexed in Scilit:
- Simulated annealing process in general state spaceAdvances in Applied Probability, 1991
- A global optimization algorithm using stochastic differential equationsACM Transactions on Mathematical Software, 1988
- Pattern dynamics and optimization by reaction diffusion systemsJournal of Statistical Physics, 1986
- Optimization strategies gleaned from biological evolutionNature, 1985
- Uses of ExchangeabilityThe Annals of Probability, 1978
- Stochastic Theory of Molecular Replication Processes with Selection CharacterAnnalen der Physik, 1977
- Coherent random walks arising in some genetical modelsProceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, 1976
- Equilibrium behavior of population genetic models with non-random mating. Part I: Preliminaries and special mating systemsJournal of Applied Probability, 1968
- Random search techniques for optimization problemsAutomatica, 1963
- Central Limit Theorems for Interchangeable ProcessesCanadian Journal of Mathematics, 1958