Successive refinement of information
- 1 March 1991
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 37 (2) , 269-275
- https://doi.org/10.1109/18.75242
Abstract
The successive refinement of information consists of first approximating data using a few bits of information, then iteratively improving the approximation as more and more information is supplied. The goal is to achieve an optimal description at each stage. In general, an ongoing description which is rate-distortion optimal whenever it is interrupted is sought. It is shown that in order to achieve optimal successive refinement the necessary and sufficient conditions are that the solutions of the rate distortion problem can be written as a Markov chain. In particular, all finite alphabet signals with Hamming distortion satisfy these requirements. It is also shown that the same is true for Gaussian signals with squared error distortion and for Laplacian signals with absolute error distortion. A simple counterexample with absolute error distortion and a symmetric source distribution which shows that successive refinement is not always achievable is presented.Keywords
This publication has 16 references indexed in Scilit:
- Variable rate vector quantization for medical image compressionIEEE Transactions on Medical Imaging, 1990
- Optimal pruning with applications to tree-structured source coding and modelingIEEE Transactions on Information Theory, 1989
- New results in binary multiple descriptionsIEEE Transactions on Information Theory, 1987
- Achievable rates for multiple descriptionsIEEE Transactions on Information Theory, 1982
- Rate-distortion for correlated sources with partially separated encodersIEEE Transactions on Information Theory, 1982
- Source coding theory for cascade and branching communication systemsIEEE Transactions on Information Theory, 1981
- On a Source-Coding Problem with Two Channels and Three ReceiversBell System Technical Journal, 1980
- Source Coding for Multiple DescriptionsBell System Technical Journal, 1980
- Source Coding for a Simple NetworkBell System Technical Journal, 1974
- $\varepsilon $-Entropy of a Discrete Random VariableTheory of Probability and Its Applications, 1958