Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain
Top Cited Papers
Open Access
- 4 July 2006
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLoS Biology
- Vol. 4 (8) , e233
- https://doi.org/10.1371/journal.pbio.0040233
Abstract
Avoidance learning poses a challenge for reinforcement-based theories of instrumental conditioning, because once an aversive outcome is successfully avoided an individual may no longer experience extrinsic reinforcement for their behavior. One possible account for this is to propose that avoiding an aversive outcome is in itself a reward, and thus avoidance behavior is positively reinforced on each trial when the aversive outcome is successfully avoided. In the present study we aimed to test this possibility by determining whether avoidance of an aversive outcome recruits the same neural circuitry as that elicited by a reward itself. We scanned 16 human participants with functional MRI while they performed an instrumental choice task, in which on each trial they chose from one of two actions in order to either win money or else avoid losing money. Neural activity in a region previously implicated in encoding stimulus reward value, the medial orbitofrontal cortex, was found to increase, not only following receipt of reward, but also following successful avoidance of an aversive outcome. This neural signal may itself act as an intrinsic reward, thereby serving to reinforce actions during instrumental avoidance.Keywords
This publication has 51 references indexed in Scilit:
- Orbitofrontal Cortex, Associative Learning, and ExpectanciesNeuron, 2005
- Opponent appetitive-aversive neural processes underlie predictive learning of pain reliefNature Neuroscience, 2005
- Parsing rewardPublished by Elsevier ,2003
- Emotion, Decision Making and the Orbitofrontal CortexCerebral Cortex, 2000
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- A Neural Substrate of Prediction and RewardScience, 1997
- Insensitivity to future consequences following damage to human prefrontal cortexCognition, 1994
- A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.Psychological Review, 1980
- A theory of attention: Variations in the associability of stimuli with reinforcement.Psychological Review, 1975
- An opponent-process theory of motivation: I. Temporal dynamics of affect.Psychological Review, 1974