Optimal entropy-constrained scalar quantization of a uniform source
- 1 January 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 46 (7) , 2704-2711
- https://doi.org/10.1109/18.887885
Abstract
Optimal scalar quantization subject to an entropy constraint is studied for a wide class of difference distortion measures including rth-power distortions with r>0. It is proved that if the source is uniformly distributed over an interval, then for any entropy constraint R (in nats), an optimal quantizer has N=[eR] interval cells such that N-1 cells have equal length d and one cell has length c⩽d. The cell lengths are uniquely determined by the requirement that the entropy constraint is satisfied with equality. Based on this result, a parametric representation of the minimum achievable distortion Dh (R) as a function of the entropy constraint R is obtained for a uniform source. The Dh(R) curve turns out to be nonconvex in general. Moreover, for the squared-error distortion it is shown that D h(R) is a piecewise-concave function, and that a scalar quantizer achieving the lower convex hull of Dh(R) exists only at rates R=log N, where N is a positive integerKeywords
This publication has 11 references indexed in Scilit:
- Asymptotic performance of vector quantizers with the perceptual distortion measurePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Sequential coding of correlated sourcesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Elements of Information TheoryPublished by Wiley ,2001
- High-resolution source coding for non-difference distortion measures: multidimensional compandingIEEE Transactions on Information Theory, 1999
- High-resolution source coding for non-difference distortion measures: the rate-distortion functionIEEE Transactions on Information Theory, 1999
- Systematic lossy source/channel codingIEEE Transactions on Information Theory, 1998
- The rate loss in the Wyner-Ziv problemIEEE Transactions on Information Theory, 1996
- The rate-distortion function for source coding with side information at the decoder\3-II: General sourcesInformation and Control, 1978
- The rate-distortion function for source coding with side information at the decoderIEEE Transactions on Information Theory, 1976
- A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functionsIEEE Transactions on Information Theory, 1973