The distribution of the sequential decoding computation time
- 1 April 1966
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 12 (2) , 143-147
- https://doi.org/10.1109/tit.1966.1053875
Abstract
Previous studies of sequential decoding algorithms have shown that the computation time required per decoded digit is small, on the average, when the source rate is less than a rateR_{comp}. In this paper, we consider the probability distribution of the computation time per decoded digit for the Fano algorithm on the binary symmetric channel. We show by underbounding this distribution that it behaves asL^{-alpha}, alpha > 0, in the distribution parameterL, that is, it is of the Pareto type. We deduce from this fact that the probability of overflowing the buffer required to store data during periods of high computation is relatively insensitive to the buffer storage capacity and to the maximum speed of the accompanying logic unit. It is shown that this lack of sensitivity exists because the computation per decoded digit is large during intervals of high channel noise and grows exponentially with the length of such an interval. The overflow probability, however, is a strong function of the source rate and is more than squared by a halving of this rate.Keywords
This publication has 6 references indexed in Scilit:
- The Performance of Sequential Decoding in Conjunction with Efficient ModulationIEEE Transactions on Communications, 1966
- Self-Similar Error Clusters in Communication Systems and the Concept of Conditional StationarityIEEE Transactions on Communications, 1965
- THE COMPUTATION PROBLEM WITH SEQUENTIAL DECODINGPublished by Defense Technical Information Center (DTIC) ,1965
- A simple derivation of the coding theorem and some applicationsIEEE Transactions on Information Theory, 1965
- A New Model for Error Clustering in Telephone CircuitsIBM Journal of Research and Development, 1963
- A heuristic discussion of probabilistic decodingIEEE Transactions on Information Theory, 1963