Random Search in the Presence of Noise, with Application to Machine Learning
- 1 July 1990
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Scientific and Statistical Computing
- Vol. 11 (4) , 702-712
- https://doi.org/10.1137/0911041
Abstract
A search for the global minimum of a function is proposed; the search is on the basis of sequential noisy measurements. Because no unimodality assumptions are made, stochastic approximation and other well-known methods are not directly applicable. The search plan is shown to be convergent in probability to a set of minimizers. This study was motivated by investigations into machine learning. This setting is explained, and the methodology is applied to create an adaptively improving strategy for 8-puzzle problems.Keywords
This publication has 13 references indexed in Scilit:
- Asymptotic Global Behavior for Stochastic Approximation and Diffusions with Slowly Decreasing Noise Effects: Global Minimization via Monte CarloSIAM Journal on Applied Mathematics, 1987
- Asymptotically efficient adaptive allocation rulesAdvances in Applied Mathematics, 1985
- Bandit problemsPublished by Springer Nature ,1985
- Weak and strong uniform consistency of kernel regression estimatesProbability Theory and Related Fields, 1982
- Contributions to the Theory of Nonparametric Regression, with Application to System IdentificationThe Annals of Statistics, 1979
- Progressive global random search of continuous functionsMathematical Programming, 1978
- The uniform convergence of nearest neighbor regression function estimators and their application in optimizationIEEE Transactions on Information Theory, 1978
- Optimization Strategies in Adaptive Control: A Selective SurveyIEEE Transactions on Systems, Man, and Cybernetics, 1975
- Experiments with the Graph Traverser programProceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, 1966
- Stochastic Estimation of the Maximum of a Regression FunctionThe Annals of Mathematical Statistics, 1952