THEORIES OF PROBABILISTIC REINFORCEMENT
- 1 January 1989
- journal article
- research article
- Published by Wiley in Journal of the Experimental Analysis of Behavior
- Vol. 51 (1) , 87-99
- https://doi.org/10.1901/jeab.1989.51-87
Abstract
In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In Experiments 1 and 2, the intertrial interval was varied across conditions, and these variations had no systematic effects on choice. In Experiment 3, the stimuli that followed a choice of the red key differed across conditions. In some conditions, a red houselight was presented for 5 s after each choice of the red key. In other conditions, the red houselight was present on reinforced trials but not on nonreinforced trials. Subjects exhibited greater preference for the red key in the latter case. The results were used to evaluate four different theories of probabilistic reinforcement. The results were most consistent with the view that the value or effectiveness of a probabilistic reinforcer is determined by the total time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. According to this view, probabilistic reinforcers are analogous to reinforcers that are delivered after variable delays.Keywords
This publication has 20 references indexed in Scilit:
- Decision-Making in the Presence of RiskScience, 1987
- Cognition and behavior in studies of choice.Psychological Review, 1986
- Fixed and variable ratios and delays: Further tests of an equivalence rule.Journal of Experimental Psychology: Animal Behavior Processes, 1986
- PROBABILITY AND DELAY OF REINFORCEMENT AS FACTORS IN DISCRETE‐TRIAL CHOICEJournal of the Experimental Analysis of Behavior, 1985
- An empirical demonstration of risk-sensitive foraging preferencesAnimal Behaviour, 1980
- Prospect Theory: An Analysis of Decision under RiskEconometrica, 1979
- PREFERENCE FOR MIXED VERSUS CONSTANT DELAY OF REINFORCEMENT1Journal of the Experimental Analysis of Behavior, 1976
- IMPULSE CONTROL IN PIGEONS1Journal of the Experimental Analysis of Behavior, 1974
- EFFECTS OF DELAYED REINFORCEMENT IN A CONCURRENT SITUATION1Journal of the Experimental Analysis of Behavior, 1965
- Decision making by rats: Uncertain outcome choices.Journal of Comparative and Physiological Psychology, 1965