Determining the Neural Substrates of Goal-Directed Learning in the Human Brain
Top Cited Papers
Open Access
- 11 April 2007
- journal article
- research article
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 27 (15) , 4019-4026
- https://doi.org/10.1523/jneurosci.0564-07.2007
Abstract
Instrumental conditioning is considered to involve at least two distinct learning systems: a goal-directed system that learns associations between responses and the incentive value of outcomes, and a habit system that learns associations between stimuli and responses without any link to the outcome that that response engendered. Lesion studies in rodents suggest that these two distinct components of instrumental conditioning may be mediated by anatomically distinct neural systems. The aim of the present study was to determine the neural substrates of the goal-directed component of instrumental learning in humans. Nineteen human subjects were scanned with functional magnetic resonance imaging while they learned to choose instrumental actions that were associated with the subsequent delivery of different food rewards (tomato juice, chocolate milk, and orange juice). After training, one of these foods was devalued by feeding the subject to satiety on that food. The subjects were then scanned again, while being re-exposed to the instrumental choice procedure (in extinction). We hypothesized that regions of the brain involved in goal-directed learning would show changes in their activity as a function of outcome devaluation. Our results indicate that neural activity in one brain region in particular, the orbitofrontal cortex, showed a strong modulation in its activity during selection of a devalued compared with a nondevalued action. These results suggest an important contribution of orbitofrontal cortex in guiding goal-directed instrumental choices in humans.Keywords
This publication has 45 references indexed in Scilit:
- Representation of Spatial Goals in Rat Orbitofrontal CortexNeuron, 2006
- Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value RepresentationNeuron, 2006
- Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human BrainPLoS Biology, 2006
- Cortical substrates for exploratory decisions in humansNature, 2006
- Neurons in the orbitofrontal cortex encode economic valueNature, 2006
- Orbitofrontal Cortex, Associative Learning, and ExpectanciesNeuron, 2005
- Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal CortexScience, 2003
- Emotion, Decision Making and the Orbitofrontal CortexCerebral Cortex, 2000
- Insensitivity to future consequences following damage to human prefrontal cortexCognition, 1994
- The role of response-reinforcer associations increases throughout extended instrumental trainingLearning & Behavior, 1988