Energy Aware Computing through Probabilistic Switching: A Study of Limits
- 25 July 2005
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 54 (9) , 1123-1137
- https://doi.org/10.1109/tc.2005.145
Abstract
The main result in this paper establishes the energy savings derived by using probabilistic AND as well as NOT gates constructed from an idealized switch that produces a probabilistic bit (PBIT). A probabilistic switch produces the desired value as an output that is 0 or 1 with probability p, represented as a PBIT, and, hence, can produce the wrong output value with a probability of (1-p). In contrast with a probabilistic switch, a conventional deterministic switch produces a BIT whose value is always correct. Our switch-based gate constructions are a particular case of a systematic methodology developed for building energy-aware networks for computing, using PBITS. Interesting examples of such networks include AND, OR, and NOT gates (or, as functions, Boolean conjunction, disjunction, and negation, respectively). To quantify the energy savings, novel measures of "technology independent" energy complexity are also introduced - these measures parallel conventional machine-independent notions of computational complexity such as the algorithm's running time and space. Networks of switches can be related to Turing machines and to Boolean circuits, both of which are widely known and well-understood models of computation. Our gate and network constructions lend substance to the following thesis (established for the first time by K.V. Palem): the mathematical technique referred to as randomization yielding probabilistic algorithms results in energy savings through a physical interpretation based on statistical thermodynamics and, hence, can serve as a basis for energy-aware computing. While the estimates of the energy saved through PBIT-based probabilistic computing switches and networks developed rely on the constructs and thermodynamic models due to Boltzmann, Gibbs, and Planck, this work has also led to the innovation of probabilistic CMOS-based devices and computing frameworks. Thus, for completeness, the relationship between the physical models on which this work is based and the electrical domain of CMOS-based switching is discussed.Keywords
This publication has 21 references indexed in Scilit:
- End of Moore's law: thermal (noise) death of integration in micro and nano electronicsPhysics Letters A, 2002
- Guarded evaluation: pushing power management to logic synthesis/designIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 1998
- Low power microelectronics: retrospect and prospectProceedings of the IEEE, 1995
- Conservative logicInternational Journal of Theoretical Physics, 1982
- Fluctuations and dissipation in an elementary one-bit information Storage SystemInternational Journal of Theoretical Physics, 1982
- Fast Probabilistic Algorithms for Verification of Polynomial IdentitiesJournal of the ACM, 1980
- Relations Among Complexity MeasuresJournal of the ACM, 1979
- A note on monte carlo primality tests and algorithmic information theoryCommunications on Pure and Applied Mathematics, 1978
- Noise-induced error rate as limiting factory for energy per operation in digital ICsIEEE Journal of Solid-State Circuits, 1977
- IV. On the dynamical theory of gasesPhilosophical Transactions of the Royal Society of London, 1867