Unsupervised learning of finite mixture models
Top Cited Papers
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 24 (3) , 381-396
- https://doi.org/10.1109/34.990138
Abstract
This paper proposes an unsupervised algorithm for learning a finite mixture model from multivariate data. The adjective "unsupervised" is justified by two properties of the algorithm: 1) it is capable of selecting the number of components and 2) unlike the standard expectation-maximization (EM) algorithm, it does not require careful initialization. The proposed method also avoids another drawback of EM for mixture fitting: the possibility of convergence toward a singular estimate at the boundary of the parameter space. The novelty of our approach is that we do not use a model selection criterion to choose one among a set of preestimated candidate models; instead, we seamlessly integrate estimation and model selection in a single algorithm. Our technique can be applied to any type of parametric mixture model for which it is possible to write an EM algorithm; in this paper, we illustrate it with experiments involving Gaussian mixtures. These experiments testify for the good performance of our approach.Keywords
This publication has 47 references indexed in Scilit:
- Bayesian approaches to Gaussian mixture modelingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- Detecting Features in Spatial Point Processes with Clutter via Model-Based ClusteringJournal of the American Statistical Association, 1998
- How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster AnalysisThe Computer Journal, 1998
- Linear flaw detection in woven textiles using model-based clusteringPattern Recognition Letters, 1997
- Modeling the manifolds of images of handwritten digitsIEEE Transactions on Neural Networks, 1997
- An entropy criterion for assessing the number of clusters in a mixture modelJournal of Classification, 1996
- Feature selection based on the approximation of class densities by finite mixtures of special typePattern Recognition, 1995
- Information Ratios for Validating Mixture AnalysesJournal of the American Statistical Association, 1992
- Unsupervised texture segmentation using Gabor filtersPattern Recognition, 1991
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978