The rate-distortion function on classes of sources determined by spectral capacities
- 1 January 1982
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 28 (1) , 19-26
- https://doi.org/10.1109/tit.1982.1056450
Abstract
The quantity\sup_{a \in \cal R} R{a}(D)is considered, where\cal Ris a class of homogeneousn-parameter sources andR_{a}(D)denotes the single-letter mean-square-error (MSE) rate-distortion function for the individual source a. In particular, the case in which the class\cal Ris specified in terms of spectral information is treated for general classes of spectral measures whose upper measures are capacities (in the sense of Choquet) alternating of order two. This type of class includes many common models for spectral uncertainty such as mixture models, spectral band models, and neighborhoods generated by variation and Prohorov metrics. It is shown that each such class contains a worst-case source whose rate-distortion function achieves the supremum over the class for each value of distortion. This source is characterized as having a spectral density that is a derivative (in the sense of Huber and Strassen) of the upper spectral measure with respect to Lebesgue measure on[-\pi,\pi]^{n}. Moreover it is shown that the spectral measure of the worst-case source is closest, in a sense defined by directed divergence, to Lebesgue measure (which corresponds to a memoryless source). Numerical results are presented for the particular case in which the source spectral measure is a mixture of a Gauss-Markov spectrum and an unknown contaminating component.Keywords
This publication has 15 references indexed in Scilit:
- Minimax Linear Smoothing for CapacitiesThe Annals of Probability, 1982
- Robust hypothesis testing for bounded classes of probability densities (Corresp.)IEEE Transactions on Information Theory, 1981
- On robust wiener filteringIEEE Transactions on Automatic Control, 1980
- Robust Wiener filtersJournal of the Franklin Institute, 1977
- Least Favorable Pairs for Special CapacitiesThe Annals of Statistics, 1977
- Robust detection of a known signal in nearly Gaussian noiseIEEE Transactions on Information Theory, 1971
- The rate of a class of random processesIEEE Transactions on Information Theory, 1970
- Robust confidence limitsProbability Theory and Related Fields, 1968
- The Existence of Probability Measures with Given MarginalsThe Annals of Mathematical Statistics, 1965
- Theory of capacitiesAnnales de l'institut Fourier, 1954