Thermodynamic depth of causal states: Objective complexity via minimal representations
- 1 January 1999
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 59 (1) , 275-283
- https://doi.org/10.1103/physreve.59.275
Abstract
Thermodynamic depth is an appealing but flawed structural complexity measure. It depends on a set of macroscopic states for a system, but neither its original introduction by Lloyd and Pagels nor any follow-up work has considered how to select these states. Depth, therefore, is at root arbitrary. Computational mechanics, an alternative approach to structural complexity, provides a definition for a system’s minimal, necessary causal states and a procedure for finding them. We show that the rate of increase in thermodynamic depth, or dive, is the system’s reverse-time Shannon entropy rate, and so depth only measures degrees of macroscopic randomness, not structure. To fix this, we redefine the depth in terms of the causal state representation—ε-machines—and show that this representation gives the minimum dive consistent with accurate prediction. Thus, ε-machines are optimally shallow.Keywords
This publication has 14 references indexed in Scilit:
- Measures of statistical complexity: Why?Physics Letters A, 1998
- The calculi of emergence: computation, dynamics and inductionPhysica D: Nonlinear Phenomena, 1994
- A comparative classification of complexity measuresChaos, Solitons, and Fractals, 1994
- Unreconstructible at any radiusPhysics Letters A, 1992
- On the phase space approach to complexityJournal of Statistical Physics, 1992
- Inferring statistical complexityPhysical Review Letters, 1989
- Complexity as thermodynamic depthAnnals of Physics, 1988
- A simple measure of complexityNature, 1988
- Toward a quantitative theory of self-generated complexityInternational Journal of Theoretical Physics, 1986
- On the Length of Programs for Computing Finite Binary SequencesJournal of the ACM, 1966