Trajectory generation and modulation using dynamic neural networks
- 21 May 2003
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 14 (3) , 520-533
- https://doi.org/10.1109/tnn.2003.810603
Abstract
Generation of desired trajectory behavior using neural networks involves a particularly challenging spatio-temporal learning problem. This paper introduces a novel solution, i.e., designing a dynamic system whose terminal behavior emulates a prespecified spatio-temporal pattern independently of its initial conditions. The proposed solution uses a dynamic neural network (DNN), a hybrid architecture that employs a recurrent neural network (RNN) in cascade with a nonrecurrent neural network (NRNN). The RNN generates a simple limit cycle, which the NRNN reshapes into the desired trajectory. This architecture is simple to train. A systematic synthesis procedure based on the design of relay control systems is developed for configuring an RNN that can produce a limit cycle of elementary complexity. It is further shown that a cascade arrangement of this RNN and an appropriately trained NRNN can emulate any desired trajectory behavior irrespective of its complexity. An interesting solution to the trajectory modulation problem, i.e., online modulation of the generated trajectories using external inputs, is also presented. Results of several experiments are included to demonstrate the capabilities and performance of the DNN in handling trajectory generation and modulation problems.Keywords
This publication has 38 references indexed in Scilit:
- Existence and learning of oscillations in recurrent neural networksIEEE Transactions on Neural Networks, 2000
- Training Algorithms for Recurrent Neural Nets that Eliminate the Need for Computation of Error Gradients with Application to Trajectory Production ProblemPublished by Taylor & Francis ,1999
- Existence, learning, and replication of periodic motions in recurrent neural networksIEEE Transactions on Neural Networks, 1998
- Recurrent neural-network training by a learning automaton approach for trajectory learning and control system designIEEE Transactions on Neural Networks, 1998
- Patterns of Dynamic Activity and Timing in Neural Network ProcessingPublished by Elsevier ,1998
- Efficient Training of Recurrent Neural Network with Time DelaysNeural Networks, 1997
- Learning long-term dependencies with gradient descent is difficultIEEE Transactions on Neural Networks, 1994
- On the problem of local minima in recurrent neural networksIEEE Transactions on Neural Networks, 1994
- An evolutionary algorithm that constructs recurrent neural networksIEEE Transactions on Neural Networks, 1994
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982