Predictive coding--II
- 1 March 1955
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 1 (1) , 24-33
- https://doi.org/10.1109/tit.1955.1055116
Abstract
In Part I predictive coding was defined and messages, prediction, entropy, and ideal coding were discussed. In the present paper the criterion to be used for predictors for the purpose of predictive coding is defined: that predictor is optimum in the information theory (IT) sense which minimizes the entropy of the average error-term distribution. Ordered averages of distributions are defined and it is shown that if a predictor gives an ordered average error term distribution it will be a best IT predictor. Special classes of messages are considered for which a best IT predictor can easily be found, and some examples are given. The error terms which are transmitted in predictive coding are treated as if they were statistically independent. If this is indeed the case, or a good approximation, then it is still necessary to show that sequences of message terms which are statistically independent may always be coded efficiently, without impractically large memory requirements, in order to show that predictive coding may be practical and efficient in such cases. This is done in the final section of this paper.Keywords
This publication has 4 references indexed in Scilit:
- Sparse Spatial Coding: A novel approach for efficient and accurate object recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Long-pulse beam stability experiments on the DARHT-II linear induction acceleratorIEEE Transactions on Plasma Science, 2006
- Statistics of Television SignalsBell System Technical Journal, 1952
- Electron Beam Deflection Tube for Pulse Code ModulationBell System Technical Journal, 1948