The Upward Bias in Measures of Information Derived from Limited Data Samples
- 1 March 1995
- journal article
- Published by MIT Press in Neural Computation
- Vol. 7 (2) , 399-407
- https://doi.org/10.1162/neco.1995.7.2.399
Abstract
Extracting information measures from limited experimental samples, such as those normally available when using data recorded in vivo from mammalian cortical neurons, is known to be plagued by a systematic error, which tends to bias the estimate upward. We calculate here the average of the bias, under certain conditions, as an asymptotic expansion in the inverse of the size of the data sample. The result agrees with numerical simulations, and is applicable, as an additive correction term, to measurements obtained under such conditions. Moreover, we discuss the implications for measurements obtained through other usual procedures.Keywords
This publication has 7 references indexed in Scilit:
- Decoding cortical neuronal signals: Network models, information estimation and spatial tuningJournal of Computational Neuroscience, 1994
- Cluster method for analysis of transmitted information in multivariate neuronal dataBiological Cybernetics, 1993
- MEASURING NATURAL NEURAL PROCESSING WITH ARTIFICIAL NEURAL NETWORKSInternational Journal of Neural Systems, 1992
- Theory of spin glassesJournal of Physics F: Metal Physics, 1975
- On the bias of information estimates.Psychological Bulletin, 1969
- Divergence of Perturbation Theory in Quantum ElectrodynamicsPhysical Review B, 1952