Individual differences and the neural representations of reward expectation and reward prediction error
Open Access
- 18 September 2006
- journal article
- Published by Oxford University Press (OUP) in Social Cognitive and Affective Neuroscience
- Vol. 2 (1) , 20-30
- https://doi.org/10.1093/scan/nsl021
Abstract
Reward expectation and reward prediction errors are thought to be critical for dynamic adjustments in decision-making and reward-seeking behavior, but little is known about their representation in the brain during uncertainty and risk-taking. Furthermore, little is known about what role individual differences might play in such reinforcement processes. In this study, it is shown behavioral and neural responses during a decision-making task can be characterized by a computational reinforcement learning model and that individual differences in learning parameters in the model are critical for elucidating these processes. In the fMRI experiment, subjects chose between high- and low-risk rewards. A computational reinforcement learning model computed expected values and prediction errors that each subject might experience on each trial. These outputs predicted subjects’ trial-to-trial choice strategies and neural activity in several limbic and prefrontal regions during the task. Individual differences in estimated reinforcement learning parameters proved critical for characterizing these processes, because models that incorporated individual learning parameters explained significantly more variance in the fMRI data than did a model using fixed learning parameters. These findings suggest that the brain engages a reinforcement learning process during risk-taking and that individual differences play a crucial role in modeling this process.Keywords
This publication has 53 references indexed in Scilit:
- Representation of Action-Specific Reward Values in the StriatumScience, 2005
- Learning and decision making in monkeys during a rock–paper–scissors gameCognitive Brain Research, 2005
- Matching Behavior and the Representation of Value in the Parietal CortexScience, 2004
- The problem of functional localization in the human brainNature Reviews Neuroscience, 2002
- Personality and Risk‐Taking: Common Bisocial FactorsJournal of Personality, 2000
- Emotion, Decision Making and the Orbitofrontal CortexCerebral Cortex, 2000
- The Variability of Human, BOLD Hemodynamic ResponsesNeuroImage, 1998
- A Neural Substrate of Prediction and RewardScience, 1997
- Deciding Advantageously Before Knowing the Advantageous StrategyScience, 1997
- Neural Basis of Saccade Target SelectionReviews in the Neurosciences, 1995