Not all (possibly) “random” sequences are created equal
- 15 April 1997
- journal article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 94 (8) , 3513-3518
- https://doi.org/10.1073/pnas.94.8.3513
Abstract
The need to assess the randomness of a single sequence, especially a finite sequence, is ubiquitous, yet is unaddressed by axiomatic probability theory. Here, we assess randomness via approximate entropy (ApEn), a computable measure of sequential irregularity, applicable to single sequences of both (even very short) finite and infinite length. We indicate the novelty and facility of the multidimensional viewpoint taken by ApEn, in contrast to classical measures. Furthermore and notably, for finite length, finite state sequences, one can identify maximally irregular sequences, and then apply ApEn to quantify the extent to which given sequences differ from maximal irregularity, via a set of deficit (def m ) functions. The utility of these def m functions which we show allows one to considerably refine the notions of probabilistic independence and normality, is featured in several studies, including ( i ) digits of e, π, √2, and √3, both in base 2 and in base 10, and ( ii ) sequences given by fractional parts of multiples of irrationals. We prove companion analytic results, which also feature in a discussion of the role and validity of the almost sure properties from axiomatic probability theory insofar as they apply to specified sequences and sets of sequences (in the physical world). We conclude by relating the present results and perspective to both previous and subsequent studies.Keywords
This publication has 32 references indexed in Scilit:
- Randomness reexaminedModeling, Identification and Control: A Norwegian Research Bulletin, 1994
- Approximate entropy: Statistical properties and applicationsCommunications in Statistics - Theory and Methods, 1992
- A Theory of Program Size Formally Identical to Information TheoryJournal of the ACM, 1975
- Randomness and Mathematical ProofScientific American, 1975
- On the Length of Programs for Computing Finite Binary SequencesJournal of the ACM, 1966
- Construction of a random sequenceBIT Numerical Mathematics, 1965
- A Study of 60,000 Digits of the Transcendental "e"The American Mathematical Monthly, 1965
- Deterministic simulation of random processesMathematics of Computation, 1963
- An ENIAC Determination of π and e to more than 2000 Decimal PlacesMathematical Tables and Other Aids to Computation, 1950
- The Construction of Decimals Normal in the Scale of TenJournal of the London Mathematical Society, 1933