An intelligent controller based on approximate reasoning and reinforcement learning

7 January 2003

conference paper
Published by Institute of Electrical and Electronics Engineers (IEEE)

p. 200-205
https://doi.org/10.1109/isic.1989.238693

Abstract

The authors introduce a novel method for designing AI (artificial intelligence)-based controllers using approximate reasoning and reinforcement learning. The approach uses linguistic control rules obtained from human expert controllers and a form of reinforcement learning related to the temporal difference method. A major characteristic of the proposed system is its ability to use past experience with an incompletely known system to predict its future behavior. The proposed method is applied in the context of a cart-pole balancing problem. The present approach learns to balance a pole within 15 trials (within 10 trials in most cases) and outperforms the previously developed schemes for this problem such as A.G. Barto et al.'s (1983) method or D. Michie and R.A. Chambers' (1968) work in the BOXES system.

Keywords

This publication has 7 references indexed in Scilit:

Electronically Controlled Continuously Variable Transmission (ECVT-II)
Published by Institute of Electrical and Electronics Engineers (IEEE) ,2005
Use of a rule-based system for process control
IEEE Control Systems Magazine, 1988
Learning to predict by the methods of temporal differences
Machine Learning, 1988
Fuzzy logic
Computer, 1988
Neuronlike adaptive elements that can solve difficult learning control problems
IEEE Transactions on Systems, Man, and Cybernetics, 1983
The concept of a linguistic variable and its application to approximate reasoning—I
Information Sciences, 1975
Some Studies in Machine Learning Using the Game of Checkers
IBM Journal of Research and Development, 1959