Information flow on trees
Open Access
- 1 August 2003
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Probability
- Vol. 13 (3) , 817-844
- https://doi.org/10.1214/aoap/1060202828
Abstract
Consider a tree network $T$, where each edge acts as an independent copy of a given channel $M$, and information is propagated from the root. For which $T$ and $M$ does the configuration obtained at level $n$ of $T$ typically contain significant information on the root variable? This problem arose independently in biology, information theory and statistical physics. For all $b$, we construct a channel for which the variable at the root of the $b$-ary tree is independent of the configuration at level 2 of that tree, yet for sufficiently large $B>b$, the mutual information between the configuration at level $n$ of the $B$-ary tree and the root variable is bounded away from zero. This is related to certain secret-sharing protocols. We improve the upper bounds on information flow for asymmetric binary channels (which correspond to the Ising model with an external field) and for symmetric $q$-ary channels (which correspond to Potts models). Let $\lam_2(M)$ denote the second largest eigenvalue of $M$, in absolute value. A CLT of Kesten and Stigum~(1966) implies that if $b |\lam_2(M)|^2 >1$, then the {\em census} of the variables at any level of the $b$-ary tree, contains significant information on the root variable. We establish a converse: if $b |\lam_2(M)|^2 < 1$, then the census of the variables at level $n$ of the $b$-ary tree is asymptotically independent of the root variable. This contrasts with examples where $b |\lam_2(M)|^2 <1$, yet the {\em configuration} at level $n$ is not asymptotically independent of the root variable.
Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Reconstruction on Trees: Beating the Second EigenvalueThe Annals of Applied Probability, 2001
- Robust Phase Transitions for Heisenberg and other Models on General TreesThe Annals of Probability, 1999
- Random Walk in a Random Environment and First-Passage Percolation on TreesThe Annals of Probability, 1992
- On the maximum tolerable noise for reliable computation by formulasIEEE Transactions on Information Theory, 1991
- Random Walks and Percolation on TreesThe Annals of Probability, 1990
- How to share a secretCommunications of the ACM, 1979
- Taxonomy with confidenceMathematical Biosciences, 1978
- Markov Random Fields on an Infinite TreeThe Annals of Probability, 1975
- Additional Limit Theorems for Indecomposable Multidimensional Galton-Watson ProcessesThe Annals of Mathematical Statistics, 1966
- A Limit Theorem for Multidimensional Galton-Watson ProcessesThe Annals of Mathematical Statistics, 1966