Theoretical limitations on the transmission of data from analog sources
- 1 October 1965
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 11 (4) , 558-567
- https://doi.org/10.1109/tit.1965.1053821
Abstract
Fundamental limitations on the performance of any type of communication system transmitting data from an analog source may be obtained by application of a theorem in Shannon's original paper on information theory. In order to transmit the output of an analog source to a sink with mean-squared error e or less, it is necessary to transmit information from source to sink at rates greater than some minimal rateR(\epsilon)bits per second. If a channel of capacityCbits per second is used, then in order for any communication system to be able to achieve\epsilonmean-squared error or less with this channel it is necessary thatR(\epsilon) \leq C. This inequality can be used to determine the minimum mean-squared error obtainable for a given source-channel pair without discussing any particular communication system. As an example, the minimum mean-squared error is calculated for cases in which the analog source and additive channel noise are stationary, Gaussian processes. The performance of amplitude and angle modulation systems is compared to the theoretically ideal performance obtainable in some of these cases.Keywords
This publication has 4 references indexed in Scilit:
- A comparison of optimum angle modulation systems and rate-distortion boundsProceedings of the IEEE, 1965
- Information rates of Gaussian signals under criteria constraining the error spectrumProceedings of the IEEE, 1964
- On the Shannon theory of information transmission in the case of continuous signalsIRE Transactions on Information Theory, 1956
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948