A least biased fuzzy clustering method
- 1 January 1994
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 16 (9) , 954-960
- https://doi.org/10.1109/34.310694
Abstract
A new operational definition of cluster is proposed, and a fuzzy clustering algorithm with minimal biases is formulated by making use of the maximum entropy principle to maximize the entropy of the centroids with respect to the data points (clustering entropy). The authors make no assumptions on the number of clusters or their initial positions. For each value of an adimensional scale parameter /spl beta/', the clustering algorithm makes each data point iterate towards one of the cluster's centroids, so that both hard and fuzzy partitions are obtained. Since the clustering algorithm can make a multiscale analysis of the given data set one can obtain both hierarchy and partitioning type clustering. The relative stability with respect to /spl beta/' of each cluster structure is defined as the measurement of cluster validity. The authors determine the specific value of /spl beta/' which corresponds to the optimal positions of cluster centroids by minimizing the entropy of the data points with respect to the centroids (clustered entropy). Examples are given to show how this least biased method succeeds in getting perceptually correct clustering results.Keywords
This publication has 8 references indexed in Scilit:
- Clustering without a metricPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- A validity measure for fuzzy clusteringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- A deterministic annealing approach to clusteringPattern Recognition Letters, 1990
- Unsupervised optimal fuzzy clusteringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1984
- Optimization by Simulated AnnealingScience, 1983
- Clustering techniques: The user's dilemmaPattern Recognition, 1976
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMSAnnals of Eugenics, 1936