A variable structure automaton used as a multimodal searching technique
- 1 July 1966
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 11 (3) , 379-387
- https://doi.org/10.1109/tac.1966.1098374
Abstract
This paper discusses a global search of a multimodal noisy performance surface using a probabilistic automaton as a model. The various regions are searched in accordance with probabilities assigned on the basis of past relative performances. The automaton has a variable structure so that the system is able to adjust its search probabilities continuously, and linear reinforcement is used as an averaging technique. The chief advantages of this procedure are the variable search probabilities and the simplicity of implementing the search (minimum amount of computations). The procedure is extended to a multidimensional case and examples are shown.Keywords
This publication has 4 references indexed in Scilit:
- A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of NoiseJournal of Basic Engineering, 1964
- A computer-simulated on-line experiment in learning control systemsPublished by Association for Computing Machinery (ACM) ,1964
- Random search techniques for optimization problemsAutomatica, 1963
- A Discussion of Random Methods for Seeking MaximaOperations Research, 1958