Neural Coding of Distinct Statistical Properties of Reward Information in Humans
Open Access
- 20 July 2005
- journal article
- research article
- Published by Oxford University Press (OUP) in Cerebral Cortex
- Vol. 16 (4) , 561-573
- https://doi.org/10.1093/cercor/bhj004
Abstract
Brain processing of reward information is essential for complex functions such as learning and motivation. Recent primate electrophysiological studies using concepts from information, economic and learning theories indicate that the midbrain may code two statistical parameters of reward information: a transient reward error prediction signal that varies linearly with reward probability and a sustained signal that varies highly non-linearly with reward probability and that is highest with maximal reward uncertainty (reward probability = 0.5). Here, using event-related functional magnetic resonance imaging, we disentangled these two signals in humans using a novel paradigm that systematically varied monetary reward probability, magnitude and expected reward value. The midbrain was activated both transiently with the error prediction signal and in a sustained fashion with reward uncertainty. Moreover, distinct activity dynamics were observed in post-synaptic midbrain projection sites: the prefrontal cortex responded to the transient error prediction signal while the ventral striatum covaried with the sustained reward uncertainty signal. These data suggest that the prefrontal cortex may generate the reward prediction while the ventral striatum may be involved in motivational processes that are useful when an organism needs to obtain more information about its environment. Our results indicate that distinct functional brain networks code different aspects of the statistical properties of reward information in humans.Keywords
This publication has 51 references indexed in Scilit:
- Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral controlNature Neuroscience, 2005
- Prediction Error during Retrospective Revaluation of Causal Associations in Humans: fMRI Evidence in Favor of an Associative Model of LearningNeuron, 2004
- Human Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification LearningJournal of Neurophysiology, 2004
- Reward, Motivation, and Reinforcement LearningNeuron, 2002
- Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and LossesNeuron, 2001
- Predictability Modulates Human Brain Response to RewardJournal of Neuroscience, 2001
- Acute and Chronic Dopamine Dynamics in a Nonhuman Primate Model of Recreational Cocaine UseJournal of Neuroscience, 2000
- Reward-dependent learning in neuronal networks for planning and decision makingPublished by Elsevier ,2000
- What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?Brain Research Reviews, 1998
- Neuronal activity in monkey striatum related to the expectation of predictable environmental eventsJournal of Neurophysiology, 1992