Sample converses in source coding theory
- 1 March 1991
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 37 (2) , 263-268
- https://doi.org/10.1109/18.75241
Abstract
The rate and distortion performance of a sequence of codes along a sample sequence of symbols generated by a stationary ergodic information source are studied. Two results are obtained: (1) the source sample sequence is encoded by an arbitrary sequence of block codes which operate at a fixed rate level R, and a sample converse is obtained which states that, with probability one, the lower limit of the code sample distortions is lower bounded by D(R), the value of the distortion rate function at R; (2) the source sample sequence is encoded by an arbitrary sequence of variable-rate codes which operate at a fixed distortion level D, and a sample converse is obtained which states that, with probability one, the lower limit of the code sample rates is lower bounded by R(D), the value of the rate distortion function at D. A novel ergodic theorem is used to obtain both sample conversesKeywords
This publication has 8 references indexed in Scilit:
- Universal Almost Sure Data CompressionThe Annals of Probability, 1990
- Entropy and Information TheoryPublished by Springer Nature ,1990
- A Sandwich Proof of the Shannon-McMillan-Breiman TheoremThe Annals of Probability, 1988
- A unified approach to weak universal source codingIEEE Transactions on Information Theory, 1978
- Block coding for an ergodic source relative to a zero-one valued fidelity criterionIEEE Transactions on Information Theory, 1978
- Variable-rate, weakly- and strongly-universal source coding subject to a fidelity constraint (Ph.D. Thesis abstr.)IEEE Transactions on Information Theory, 1977
- The Ergodic Theory of Subadditive Stochastic ProcessesJournal of the Royal Statistical Society Series B: Statistical Methodology, 1968
- Contributions to information theory for abstract alphabetsArkiv för Matematik, 1961