Generalization ability of perceptrons with continuous outputs
- 1 February 1993
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 47 (2) , 1384-1391
- https://doi.org/10.1103/physreve.47.1384
Abstract
In this paper we examine the influence of different input-output relations on the generalization ability of a single-layer perceptron. The input-output relations can be linear, binary, or sigmoid. With this choice we take into account most of the cases which are of present interest. The generalization problem will be realizable or unrealizable if the input-output relations for teacher and student are identical or not. We show that sometimes it can have a positive effect on the generalization ability, if one learns with errors.Keywords
This publication has 11 references indexed in Scilit:
- Statistical mechanics of learning from examplesPhysical Review A, 1992
- Generalization in a linear perceptron in the presence of noiseJournal of Physics A: General Physics, 1992
- Learning with noise in a linear perceptronJournal of Physics A: General Physics, 1992
- Using additive noise in back-propagation trainingIEEE Transactions on Neural Networks, 1992
- Selecting examples for perceptronsJournal of Physics A: General Physics, 1992
- Improving a Network Generalization Ability by Selecting ExamplesEurophysics Letters, 1990
- On the ability of the optimal perceptron to generaliseJournal of Physics A: General Physics, 1990
- Linear and Nonlinear Extension of the Pseudo-Inverse Solution for Learning Boolean FunctionsEurophysics Letters, 1989
- Learning of correlated patterns in spin-glass networks by local learning rulesPhysical Review Letters, 1987
- Associative recall of memory without errorsPhysical Review A, 1987