An evolutionary algorithm that constructs recurrent neural networks

1 January 1994

journal article
research article
Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks

Vol. 5 (1) , 54-65
https://doi.org/10.1109/72.265960

Abstract

Standard methods for simultaneously inducing the structure and weights of recurrent neural networks limit every task to an assumed class of architectures. Such a simplification is necessary since the interactions between network structure and function are not well understood. Evolutionary computations, which include genetic algorithms and evolutionary programming, are population-based search methods that have shown promise in many similarly complex tasks. This paper argues that genetic algorithms are inappropriate for network acquisition and describes an evolutionary program, called GNARL, that simultaneously acquires both the structure and weights for recurrent networks. GNARL's empirical acquisition method allows for the emergence of complex behaviors and topologies that are potentially excluded by the artificial architectural constraints imposed in standard network induction methods.

Keywords

This publication has 18 references indexed in Scilit:

Constructive learning of recurrent neural networks
Published by Institute of Electrical and Electronics Engineers (IEEE) ,2002
An introduction to simulated evolutionary optimization
IEEE Transactions on Neural Networks, 1994
Learning Finite State Machines With Self-Clustering Recurrent Networks
Neural Computation, 1993
Recursive dynamic node creation in multilayer neural networks
IEEE Transactions on Neural Networks, 1993
Evolving Dynamical Neural Networks for Adaptive Behavior
Adaptive Behavior, 1992
The induction of dynamical recognizers
Machine Learning, 1991
Evolving neural networks
Biological Cybernetics, 1990
Genetic algorithms and neural networks: optimizing connections and connectivity
Parallel Computing, 1990
Dynamic Node Creation in Backpropagation Networks
Connection Science, 1989
Optimization by Simulated Annealing
Science, 1983