Optimal adaptive k-means algorithm with dynamic adjustment of learning rate
- 1 January 1995
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 6 (1) , 157-169
- https://doi.org/10.1109/72.363440
Abstract
Adaptive k-means clustering algorithms have been used in several artificial neural network architectures, such as radial basis function networks or feature-map classifiers, for a competitive partitioning of the input domain. This paper presents an enhancement of the traditional k-means algorithm. It approximates an optimal clustering solution with an efficient adaptive learning rate, which renders it usable even in situations where the statistics of the problem task varies slowly with time. This modification Is based on the optimality criterion for the k-means partition stating that: all the regions in an optimal k-means partition have the same variations if the number of regions in the partition is large and the underlying distribution for generating input patterns is smooth. The goal of equalizing these variations is introduced in the competitive function that assigns each new pattern vector to the "appropriate" region. To evaluate the optimal k-means algorithm, the authors first compare it to other k-means variants on several simple tutorial examples, then the authors evaluate it on a practical application: vector quantization of image data.Keywords
This publication has 19 references indexed in Scilit:
- Fuzzy control of backpropagationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- THEORY FOR THE DEVELOPMENT OF NEURON SELECTIVITY: ORIENTATION SPECIFICITY AND BINOCULAR INTERACTION IN VISUAL CORTEXPublished by World Scientific Pub Co Pte Ltd ,1995
- Fast Learning in Networks of Locally-Tuned Processing UnitsNeural Computation, 1989
- Increased rates of convergence through learning rate adaptationNeural Networks, 1988
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982
- An Algorithm for Vector Quantizer DesignIEEE Transactions on Communications, 1980
- Asymptotically optimal block quantizationIEEE Transactions on Information Theory, 1979
- Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectorsBiological Cybernetics, 1976
- Cognitron: A self-organizing multilayered neural networkBiological Cybernetics, 1975
- Self-organization of orientation sensitive cells in the striate cortexBiological Cybernetics, 1973