Unsupervised image classification, segmentation, and enhancement using ICA mixture models
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 11 (3) , 270-279
- https://doi.org/10.1109/83.988960
Abstract
An unsupervised classification algorithm is derived by modeling observed data as a mixture of several mutually exclusive classes that are each described by linear combinations of independent, non-Gaussian densities. The algorithm estimates the data density in each class by using parametric nonlinear functions that fit to the non-Gaussian structure of the data. This improves classification accuracy compared with standard Gaussian mixture models. When applied to images, the algorithm can learn efficient codes (basis functions) for images that capture the statistically significant structure intrinsic in the images. We apply this technique to the problem of unsupervised classification, segmentation, and denoising of images. We demonstrate that this method was effective in classifying complex image textures such as natural scenes and text. It was also useful for denoising and filling in missing pixels in images with complex structures. The advantage of this model is that image codes can be learned with increasing numbers of classes thus providing greater flexibility in modeling structure and in finding more image features than in either Gaussian mixture models or standard independent component analysis (ICA) algorithms.Keywords
This publication has 23 references indexed in Scilit:
- A unifying information-theoretic framework for independent component analysisComputers & Mathematics with Applications, 2000
- Blind signal separation in teleconferencing usingICA mixture modelElectronics Letters, 2000
- Image compression via joint statistical characterization in the wavelet domainIEEE Transactions on Image Processing, 1999
- Probabilistic framework for the adaptation and comparison of image codesJournal of the Optical Society of America A, 1999
- Independent Factor AnalysisNeural Computation, 1999
- High quality document image compression with “DjVu”Journal of Electronic Imaging, 1998
- Minimax Entropy Principle and Its Application to Texture ModelingNeural Computation, 1997
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- What Is the Goal of Sensory Coding?Neural Computation, 1994