On the mutual information of memoryless channels
- 1 March 1971
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 17 (2) , 140-143
- https://doi.org/10.1109/tit.1971.1054611
Abstract
Letx_1, cdots ,x_nandy_1, cdots, y_nbe input and output sequences of a channel. In the case of memoryless input sources, the following inequality on mutual information is well known: begin{equation} I((x_1, cdots ,x_n),(y_1, cdots ,y_n)) geq sum I(x_i, y_i). end{equation} It is straightforward to show that the inequality sign is reversed if the channel instead of the input source is memoryless. In this paper we establish these inequalities when the input and output are functions instead of sequences.Keywords
This publication has 1 reference indexed in Scilit:
- Capacity of a continuous memoryless channel with feedbackIEEE Transactions on Information Theory, 1971