Self-creating and organizing neural networks
- 1 July 1994
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 5 (4) , 561-575
- https://doi.org/10.1109/72.298226
Abstract
We have developed a self-creating and organizing unsupervised learning algorithm for artificial neural networks. In this study, we introduce SCONN and SCONN2 as two versions of self-creating and organizing neural network (SCONN) algorithms. SCONN creates an adaptive uniform vector quantizer (VQ), whereas SCONN2 creates an adaptive nonuniform VQ by neural-like architecture. SCONN's begin with only one output node, which has a sufficiently wide activation level, and the activation level decrease depending upon the time or the activation history. SCONN's decide automatically whether to adapt the weights of existing nodes or to create a new “son node.” They are compared with two famous algorithms-the Kohonen's self organizing feature map (SOFM) (1988) as a neural VQ and the Linde-Buzo-Gray (LBG) algorithm (1980) as a traditional VQ. The results show that SCONN's have significant benefits over other algorithmsKeywords
This publication has 9 references indexed in Scilit:
- Variants of self-organizing mapsIEEE Transactions on Neural Networks, 1990
- Stochastic competitive learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1990
- Self-Organizing Feature MapsPublished by Springer Nature ,1988
- Vector quantization in speech codingProceedings of the IEEE, 1985
- Optimum quantizer performance for a class of non-Gaussian memoryless sourcesIEEE Transactions on Information Theory, 1984
- Asymptotic quantization error of continuous signals and the quantization dimensionIEEE Transactions on Information Theory, 1982
- Multiple local optima in vector quantizers (Corresp.)IEEE Transactions on Information Theory, 1982
- An Algorithm for Vector Quantizer DesignIEEE Transactions on Communications, 1980
- Asymptotically optimal block quantizationIEEE Transactions on Information Theory, 1979