Vector quantization and density estimation
- 23 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The connection between compression and the estimation of probability distributions has long been known for the case of discrete alphabet sources and lossless coding. A universal lossless code which does a good job of compressing must implicitly also do a good job of modeling. In particular, with a collection of codebooks, one for each possible class or model, if codewords are chosen from among the ensemble of codebooks so as to minimize bit rate, then the codebook selected provides an implicit estimate of the underlying class. Less is known about the corresponding connections between lossy compression and continuous sources. We consider aspects of estimating conditional and unconditional densities in conjunction with Bayes-risk weighted vector quantization for joint compression and classification Author(s) Gray, R.M. Inf. Syst. Lab., Stanford Univ., CA, USA Olshen, R.A.Keywords
This publication has 35 references indexed in Scilit:
- Bayes risk weighted vector quantization with CART estimated class posteriorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Bennett's integral for vector quantizersIEEE Transactions on Information Theory, 1995
- Combining image compression and classification using vector quantizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1995
- Fine-coarse vector quantizationIEEE Transactions on Signal Processing, 1991
- Theory of lattice-based fine-coarse vector quantizationIEEE Transactions on Information Theory, 1991
- Asymptotic quantization error of continuous signals and the quantization dimensionIEEE Transactions on Information Theory, 1982
- Algorithm AS 176: Kernel Density Estimation Using the Fast Fourier TransformJournal of the Royal Statistical Society Series C: Applied Statistics, 1982
- Asymptotic performance of block quantizers with difference distortion measuresIEEE Transactions on Information Theory, 1980
- Asymptotically optimal block quantizationIEEE Transactions on Information Theory, 1979
- Spectra of Quantized SignalsBell System Technical Journal, 1948