Statistical inference under multiterminal rate restrictions: a differential geometric approach
- 1 March 1989
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 35 (2) , 217-227
- https://doi.org/10.1109/18.32118
Abstract
A statistical inference problem for a two-terminal information source emitting mutually correlated signals X and Y is treated. Let sequences Xn and Yn of n independent observations be encoded independently of each other into message sets MX and MY at rates R1 and R 2 per letter, respectively. This compression causes a loss of the statistical information available for testing hypotheses concerning X and Y. The loss of statistical information is evaluated as a function of the amounts R1 and R 2 of the Shannon information. A complete solution is given in the case of asymptotically complete data compression, R1, R2→0 as n→∞. It is shown that the differential geometry of the manifold of all probability distributions plays a fundamental role in this type of multiterminal problem connecting Shannon information and statistical information. A brief introduction to the dually coupled e-affine and m-affine connections together with e -flatness and m-flatness is givenKeywords
This publication has 13 references indexed in Scilit:
- Exponential-type error probabilities for multiterminal hypothesis testingIEEE Transactions on Information Theory, 1989
- Estimation via compressed informationIEEE Transactions on Information Theory, 1988
- Differential geometry of a parametric family of invertible linear systems—Riemannian metric, dual affine connections, and divergenceTheory of Computing Systems, 1987
- Hypothesis testing with multiterminal data compressionIEEE Transactions on Information Theory, 1987
- Data compression and statistical inferenceElectronics and Communications in Japan (Part I: Communications), 1987
- Hypothesis testing with communication constraintsIEEE Transactions on Information Theory, 1986
- The relation between information theory and the differential geometry approach to statisticsInformation Sciences, 1985
- Differential Geometry of Curved Exponential Families-Curvatures and Information LossThe Annals of Statistics, 1982
- The Geometry of Exponential FamiliesThe Annals of Statistics, 1978
- $I$-Divergence Geometry of Probability Distributions and Minimization ProblemsThe Annals of Probability, 1975