Evolving neural networks to play checkers without relying on expert knowledge
- 1 January 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 10 (6) , 1382-1391
- https://doi.org/10.1109/72.809083
Abstract
An experiment was conducted where neural networks compete for survival in an evolving population based on their ability to play checkers. More specifically, multilayer feedforward neural networks were used to evaluate alternative board positions and games were played using a minimax search strategy. At each generation, the extant neural networks were paired in competitions and selection was used to eliminate those that performed poorly relative to other networks. Offspring neural networks were created from the survivors using random variation of all weights and bias terms. After a series of 250 generations, the best-evolved neural network was played against human opponents in a series of 90 games on an internet website. The neural network was able to defeat two expert-level players and played to a draw against a master. The final rating of the neural network placed it in the "Class A" category using a standard rating system. Of particular importance in the design of the experiment was the fact that no features beyond the piece differential were given to the neural networks as a priori knowledge. The process of evolution was able to extract all of the additional information required to play at this level of competency. It accomplished this based almost solely on the feedback offered in the final aggregated outcome of each game played (i.e., win, lose, or draw). This procedure stands in marked contrast to the typical artifice of explicitly injecting expert knowledge into a game-playing program.Keywords
This publication has 8 references indexed in Scilit:
- Co-Evolution in the Successful Learning of Backgammon StrategyMachine Learning, 1998
- Comments on “Co-Evolution in the Successful Learning of Backgammon Strategy”Machine Learning, 1998
- Discovering Complex Othello Strategies through Evolutionary Neural NetworksConnection Science, 1995
- Practical issues in temporal difference learningMachine Learning, 1992
- A world championship caliber checkers programArtificial Intelligence, 1992
- Tree Searching AlgorithmsPublished by Springer Nature ,1990
- Steps toward Artificial IntelligenceProceedings of the IRE, 1961
- Some Studies in Machine Learning Using the Game of CheckersIBM Journal of Research and Development, 1959