Neural modeling for time series: A statistical stepwise method for weight elimination
- 1 January 1995
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 6 (6) , 1355-1364
- https://doi.org/10.1109/72.471372
Abstract
Many authors use feedforward neural networks for modeling and forecasting time series. Most of these applications are mainly experimental, and it is often difficult to extract a general methodology from the published studies. In particular, the choice of architecture is a tricky problem. We try to combine the statistical techniques of linear and nonlinear time series with the connectionist approach. The asymptotical properties of the estimators lead us to propose a systematic methodology to determine which weights are nonsignificant and to eliminate them to simplify the architecture. This method (SSM or statistical stepwise method) is compared to other pruning techniques and is applied to some artificial series, to the famous Sunspots benchmark, and to daily electrical consumption data.Keywords
This publication has 19 references indexed in Scilit:
- Progress in forecasting by neural networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Short term electric load forecasting using an adaptively trained layered perceptronPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Pruning algorithms-a surveyIEEE Transactions on Neural Networks, 1993
- Multilayer feedforward networks with a nonpolynomial activation function can approximate any functionNeural Networks, 1993
- Exact Calculation of the Hessian Matrix for the Multilayer PerceptronNeural Computation, 1992
- A Practical Bayesian Framework for Backpropagation NetworksNeural Computation, 1992
- Short-term load forecasting using an artificial neural networkIEEE Transactions on Power Systems, 1992
- Approximation by superpositions of a sigmoidal functionMathematics of Control, Signals, and Systems, 1989
- On the approximate realization of continuous mappings by neural networksNeural Networks, 1989
- Learning of word stress in a sub-optimal second order back-propagation neural networkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1988