Parameter estimation with multiterminal data compression
- 1 January 1995
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 41 (6) , 1802-1833
- https://doi.org/10.1109/18.476308
Abstract
The multiterminal estimation theory deals with an entirely novel problem which takes place in the void between information theory and statistics, that is, what amount of Fisher information can be attained under a restriction on the amount of Shannon information. The key idea here is the indivisible fusion of the information-theoretic universal coding problem and the statistical maximum-likelihood parameter estimation problem. The main result is the explicit establishment of maximum-likelihood estimators attainable under the rate-constrained universal coding scheme, which is shown to have a variance equal to the inverse of the Fisher information. This may be regarded as giving a multiterminal generalization of the usual Cramer-Rao bound. Relevant properties and examples of these maximum-likelihood estimators are also shownKeywords
This publication has 11 references indexed in Scilit:
- Fisher information under restriction of Shannon information in multi-terminal situationsAnnals of the Institute of Statistical Mathematics, 1989
- Statistical inference under multiterminal rate restrictions: a differential geometric approachIEEE Transactions on Information Theory, 1989
- Exponential-type error probabilities for multiterminal hypothesis testingIEEE Transactions on Information Theory, 1989
- Estimation via compressed informationIEEE Transactions on Information Theory, 1988
- Hypothesis testing with multiterminal data compressionIEEE Transactions on Information Theory, 1987
- Hypothesis testing with communication constraintsIEEE Transactions on Information Theory, 1986
- Differential-Geometrical Methods in StatisticsPublished by Springer Nature ,1985
- $I$-Divergence Geometry of Probability Distributions and Minimization ProblemsThe Annals of Probability, 1975
- Linear Statistical Inference and its ApplicationsPublished by Wiley ,1973
- On the foundations of combinatorial theory I. Theory of M bius FunctionsProbability Theory and Related Fields, 1964