On the achievable information rates of finite-state input two-dimensional channels with memory
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21578095,p. 2354-2358
- https://doi.org/10.1109/isit.2005.1523769
Abstract
The achievable information rate of finite-state input two-dimensional (2-D) channels with memory is an open problem, which is relevant, e.g., for inter-symbol-interference (ISI) channels and cellular multiple-access channels. We propose a method for simulation-based computation of such information rates. We first draw a connection between the Shannon-theoretic information rate and the statistical mechanics notion of free energy. Since the free energy of such systems is intractable, we approximate it using the cluster variation method, implemented via generalized belief propagation. The derived, fully tractable, algorithm is shown to provide a practically accurate estimate of the information rate. In our experimental study we calculate the information rates of 2-D ISI channels and of hexagonal Wyner cellular networks with binary inputs, for which formerly only bounds were knownKeywords
This publication has 13 references indexed in Scilit:
- Constructing Free-Energy Approximations and Generalized Belief Propagation AlgorithmsIEEE Transactions on Information Theory, 2005
- Generalized belief propagation receiver for near-optimal detection of two-dimensional channels with memoryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Markov sources achieve the feedback capacity of finite-state machine channelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A statistical-mechanics approach to large-system analysis of CDMA multiuser detectorsIEEE Transactions on Information Theory, 2002
- On the capacity of Markov sources over noisy channelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Elements of Information TheoryPublished by Wiley ,2001
- The intersymbol interference channel: lower bounds on capacity and channel precoding lossIEEE Transactions on Information Theory, 1996
- Shannon-theoretic approach to a Gaussian cellular multiple-access channelIEEE Transactions on Information Theory, 1994
- Maximum-likelihood estimation for hidden Markov modelsStochastic Processes and their Applications, 1992
- Information rates for a discrete-time Gaussian channel with intersymbol interference and stationary inputsIEEE Transactions on Information Theory, 1991