A direct adaptive method for faster backpropagation learning: the RPROP algorithm
Top Cited Papers
- 30 December 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 586-591 vol.1
- https://doi.org/10.1109/icnn.1993.298623
Abstract
A learning algorithm for multilayer feedforward networks, RPROP (resilient propagation), is proposed. To overcome the inherent disadvantages of pure gradient-descent, RPROP performs a local adaptation of the weight-updates according to the behavior of the error function. Contrary to other adaptive techniques, the effect of the RPROP adaptation process is not blurred by the unforeseeable influence of the size of the derivative, but only dependent on the temporal behavior of its sign. This leads to an efficient and transparent adaptation process. The capabilities of RPROP are shown in comparison to other adaptive techniques.<>Keywords
This publication has 3 references indexed in Scilit:
- SuperSAB: Fast adaptive back propagation with good scaling propertiesNeural Networks, 1990
- Increased rates of convergence through learning rate adaptationNeural Networks, 1988
- Parallel Distributed ProcessingPublished by MIT Press ,1986