Mapping value based planning and extensively trained choice in the human brain
Top Cited Papers
Open Access
- 11 March 2012
- journal article
- research article
- Published by Springer Nature in Nature Neuroscience
- Vol. 15 (5) , 786-791
- https://doi.org/10.1038/nn.3068
Abstract
Using a combination of fMRI in humans and computational modeling, the authors show that different striatal nuclei encode different kinds of decision-making information. The anterior caudate nucleus encodes the value of individual steps in a decision tree, whereas the putamen encodes values learnt during extensive training. Investigations of the underlying mechanisms of choice in humans have focused on learning from prediction errors, leaving the computational structure of value based planning comparatively underexplored. Using behavioral and neuroimaging analyses of a minimax decision task, we found that the computational processes underlying forward planning are expressed in the anterior caudate nucleus as values of individual branching steps in a decision tree. In contrast, values represented in the putamen pertain solely to values learned during extensive training. During actual choice, both striatal areas showed a functional coupling to ventromedial prefrontal cortex, consistent with this region acting as a value comparator. Our findings point toward an architecture of choice in which segregated value systems operate in parallel in the striatum for planning and extensively trained choices, with medial prefrontal cortex integrating their outputs.Keywords
This publication has 50 references indexed in Scilit:
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- A specific role for posterior dorsolateral striatum in human habit learningEuropean Journal of Neuroscience, 2009
- Calculating Consequences: Brain Systems That Encode the Causal Effects of ActionsJournal of Neuroscience, 2008
- Temporal difference models describe higher-order learning in humansNature, 2004
- Modulation of Caudate Activity by Action ContingencyNeuron, 2004
- Temporal Difference Models and Reward-Related Learning in the Human BrainNeuron, 2003
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Specific impairments of planningPhilosophical Transactions of the Royal Society of London. B, Biological Sciences, 1982
- Some Studies in Machine Learning Using the Game of CheckersIBM Journal of Research and Development, 1959