Smooth Function Approximation Using Neural Networks
Top Cited Papers
- 31 January 2005
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 16 (1) , 24-38
- https://doi.org/10.1109/tnn.2004.836233
Abstract
An algebraic approach for representing multidimensional nonlinear functions by feedforward neural networks is presented. In this paper, the approach is implemented for the approximation of smooth batch data containing the function's input, output, and possibly, gradient information. The training set is associated to the network adjustable parameters by nonlinear weight equations. The cascade structure of these equations reveals that they can be treated as sets of linear systems. Hence, the training process and the network approximation properties can be investigated via linear algebra. Four algorithms are developed to achieve exact or approximate matching of input-output and/or gradient-based training sets. Their application to the design of forward and feedback neurocontrollers shows that algebraic training is characterized by faster execution speeds and better generalization properties than contemporary optimization techniques.Keywords
This publication has 25 references indexed in Scilit:
- Theory and algorithms for nonuniform spline waveletsPublished by Cambridge University Press (CUP) ,2001
- The Use of Polynomial Splines and Their Tensor Products in Multivariate Function EstimationThe Annals of Statistics, 1994
- Training feedforward networks with the Marquardt algorithmIEEE Transactions on Neural Networks, 1994
- Identification of aerodynamic coefficients using computational neural networksJournal of Guidance, Control, and Dynamics, 1993
- Universal approximation bounds for superpositions of a sigmoidal functionIEEE Transactions on Information Theory, 1993
- Multivariate Adaptive Regression SplinesThe Annals of Statistics, 1991
- Identification and control of dynamical systems using neural networksIEEE Transactions on Neural Networks, 1990
- Backpropagation through time: what it does and how to do itProceedings of the IEEE, 1990
- Learning representations by back-propagating errorsNature, 1986
- Practical spline approximationPublished by Springer Nature ,1982