Entropy and recurrence rates for stationary random fields

17 December 2002

conference paper
Published by Institute of Electrical and Electronics Engineers (IEEE)

p. 179
https://doi.org/10.1109/isit.1994.394793

Abstract

The entropy of a stationary multidimensional array of random variables is related to the rate of recurrence of the patterns that are seen in the center of the array. The results give the possibility of calculating the entropy of a (stochastic) process from a single set of observations without computation of probabilities.<>

Keywords

ENTROPY
MATHEMATICS
STOCHASTIC PROCESSES
RANDOM VARIABLES
PROBABILITY
EXTRATERRESTRIAL MEASUREMENTS
DATA COMPRESSION

This publication has 4 references indexed in Scilit:

Entropy and data compression schemes
IEEE Transactions on Information Theory, 1993
How Sampling Reveals a Process
The Annals of Probability, 1990
Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data compression
IEEE Transactions on Information Theory, 1989
The Shannon-McMillan-Breiman theorem for a class of amenable groups
Israel Journal of Mathematics, 1983