Midbrain dopamine neurons encode decisions for future action
Top Cited Papers
- 23 July 2006
- journal article
- Published by Springer Nature in Nature Neuroscience
- Vol. 9 (8) , 1057-1063
- https://doi.org/10.1038/nn1743
Abstract
Current models of the basal ganglia and dopamine neurons emphasize their role in reinforcement learning. However, the role of dopamine neurons in decision making is still unclear. We recorded from dopamine neurons in monkeys engaged in two types of trial: reference trials in an instructed-choice task and decision trials in a two-armed bandit decision task. We show that the activity of dopamine neurons in the decision setting is modulated according to the value of the upcoming action. Moreover, analysis of the probability matching strategy in the decision trials revealed that the dopamine population activity and not the reward during reference trials determines choice behavior. Because dopamine neurons do not have spatial or motor properties, we conclude that immediate decisions are likely to be generated elsewhere and conveyed to the dopamine neurons, which play a role in shaping long-term decision policy through dynamic modulation of the efficacy of basal ganglia synapses.Keywords
This publication has 34 references indexed in Scilit:
- Representation of Action-Specific Reward Values in the StriatumScience, 2005
- Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error SignalNeuron, 2005
- Matching Behavior and the Representation of Value in the Parietal CortexScience, 2004
- Prefrontal cortex and decision making in a mixed-strategy gameNature Neuroscience, 2004
- Neuronal Correlates of a Perceptual Decision in Ventral Premotor CortexNeuron, 2004
- Reward, Motivation, and Reinforcement LearningNeuron, 2002
- Activity in human ventral striatum locked to errors of reward predictionNature Neuroscience, 2002
- A Neural Substrate of Prediction and RewardScience, 1997
- The Framing of Decisions and the Psychology of ChoiceScience, 1981
- ON THE LAW OF EFFECT1Journal of the Experimental Analysis of Behavior, 1970