Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity
Top Cited Papers
- 1 April 2004
- journal article
- research article
- Published by MIT Press in Neural Computation
- Vol. 16 (4) , 717-736
- https://doi.org/10.1162/089976604322860677
Abstract
Normalized Lempel-Ziv complexity, which measures the generation rate of new patterns along a digital sequence, is closely related to such important source properties as entropy and compression ratio, but, in contrast to these, it is a property of individual sequences. In this article, we propose to exploit this concept to estimate (or, at least, to bound from below) the entropy of neural discharges (spike trains). The main advantages of this method include fast convergence of the estimator (as supported by numerical simulation) and the fact that there is no need to know the probability law of the process generating the signal. Furthermore, we present numerical and experimental comparisons of the new method against the standard method based on word frequencies, providing evidence that this new approach is an alternative entropy estimator for binned spike trains.Keywords
This publication has 11 references indexed in Scilit:
- Estimation of Entropy and Mutual InformationNeural Computation, 2003
- On the number of states of the neuronal sourcesBiosystems, 2003
- Temporal Coding of Visual Information in the ThalamusJournal of Neuroscience, 2000
- Membrane Mechanisms Underlying Contrast Adaptation in Cat Area 17In VivoJournal of Neuroscience, 2000
- Entropy and Information in Neural Spike TrainsPhysical Review Letters, 1998
- Classifying simple and complex cells on the basis of response modulationVision Research, 1991
- Compression of individual sequences via variable-rate codingIEEE Transactions on Information Theory, 1978
- On the Complexity of Finite SequencesIEEE Transactions on Information Theory, 1976
- The limiting information capacity of a neuronal linkBulletin of Mathematical Biology, 1952
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948