The Structures of Automata to Adapt to an Unknown Environment
- 1 July 1976
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics
- Vol. SMC-6 (7) , 494-504
- https://doi.org/10.1109/tsmc.1976.4309535
Abstract
A general fixed structure automaton acting in stationary random multireaction environment is described. Some necessary conditions are shown for automata to be purposeful or adaptive in an unknown environment (to be more profitable than a no-purpose, or random, automaton). By the necessary conditions it is proved that there exists no perfectly adaptive automaton. A necessary condition for automata with minimum state space to be purposeful is obtained. This condition characterizes their structures explicitly, so that a little restriction gives a sufficient condition. Some general subclasses of automata are proposed, and necessary and sufficient conditions for such automata to be purposeful are investigated. Furthermore as properties of a purposeful automaton, the time required to adapt and the stability of adapting to the random environment are discussed.Keywords
This publication has 7 references indexed in Scilit:
- Games of Stochastic AutomataIEEE Transactions on Systems, Man, and Cybernetics, 1974
- Two ?-Optimal Nonlinear Reinforcement Schemes for Stochastic AutomataIEEE Transactions on Systems, Man, and Cybernetics, 1974
- Stochastic Automata Models with Applications to Learning SystemsIEEE Transactions on Systems, Man, and Cybernetics, 1973
- Optimal non-linear reinforcement schemes for stochastic automataInformation Sciences, 1972
- Stochastic Automata GamesIEEE Transactions on Systems Science and Cybernetics, 1969
- Use of Stochastic Automata for Parameter Self-Optimization with Multimodal Performance CriteriaIEEE Transactions on Systems Science and Cybernetics, 1969
- On Expediency and Convergence in Variable-Structure AutomataIEEE Transactions on Systems Science and Cybernetics, 1968