Capacity of channels with uncoded side information
- 1 September 1995
- journal article
- information processing
- Published by Wiley in European Transactions on Telecommunications
- Vol. 6 (5) , 587-600
- https://doi.org/10.1002/ett.4460060514
Abstract
Parallel independent channels where no encoding is allowed for one of the channels are studied. The Slepian‐Wolf theorem on source coding of correlated sources is used to show that any information source whose entropy rate is below the sum of the capacity of the coded channel and the input/output mutual information of the uncoded channel is transmissible with arbitrary reliability. The converse is also shown. Thus, coding of the side information channel is unnecessary when its mutual information is maximized by the source distribution. Applications to superposed coded/uncoded transmission on Gaussian channels are studied and an information‐theoretic interpretation of Parallel‐Concatenated channel codes and, in particular. Turbo codes is put forth.Keywords
This publication has 15 references indexed in Scilit:
- Turbo codes for PCS applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Average performance of parallel concatenated blockcodesElectronics Letters, 1995
- Performance evaluation of turbo codes for shortframetransmission systemsElectronics Letters, 1994
- Approximation theory of output statisticsIEEE Transactions on Information Theory, 1993
- Information rates for a discrete-time Gaussian channel with intersymbol interference and stationary inputsIEEE Transactions on Information Theory, 1991
- Abstract Dynamic Programming Models under Commutativity ConditionsSIAM Journal on Control and Optimization, 1987
- A proof of the data compression theorem of Slepian and Wolf for ergodic sources (Corresp.)IEEE Transactions on Information Theory, 1975
- Recent results in the Shannon theoryIEEE Transactions on Information Theory, 1974
- Noiseless coding of correlated information sourcesIEEE Transactions on Information Theory, 1973
- Convolutional codes I: Algebraic structureIEEE Transactions on Information Theory, 1970