Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Top Cited Papers
Open Access
- 30 October 2011
- journal article
- research article
- Published by Springer Nature in Nature Neuroscience
- Vol. 14 (12) , 1590-1597
- https://doi.org/10.1038/nn.2957
Abstract
The orbitofrontal cortex (OFC) has been hypothesized to carry information regarding the value of expected rewards. Such information could be used for generating instructive error signals conveyed by dopamine neurons. Here the authors report that this is indeed the case. However, contrary to the simplest hypothesis, OFC lesions did not result in the loss of all value information. Instead, lesions caused the loss of value information derived from model-based representations. The orbitofrontal cortex has been hypothesized to carry information regarding the value of expected rewards. Such information is essential for associative learning, which relies on comparisons between expected and obtained reward for generating instructive error signals. These error signals are thought to be conveyed by dopamine neurons. To test whether orbitofrontal cortex contributes to these error signals, we recorded from dopamine neurons in orbitofrontal-lesioned rats performing a reward learning task. Lesions caused marked changes in dopaminergic error signaling. However, the effect of lesions was not consistent with a simple loss of information regarding expected value. Instead, without orbitofrontal input, dopaminergic error signals failed to reflect internal information about the impending response that distinguished externally similar states leading to differently valued future rewards. These results are consistent with current conceptualizations of orbitofrontal cortex as supporting model-based behavior and suggest an unexpected role for this information in dopaminergic error signaling.Keywords
This publication has 51 references indexed in Scilit:
- Distributed Coding of Actual and Hypothetical Outcomes in the Orbital and Dorsolateral Prefrontal CortexNeuron, 2011
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- Start/stop signals emerge in nigrostriatal circuits during sequence learningNature, 2010
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- Learning latent structure: carving nature at its jointsCurrent Opinion in Neurobiology, 2010
- Separable Learning Systems in the Macaque Brain and the Role of Orbitofrontal Cortex in Contingent LearningNeuron, 2010
- The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected OutcomesPublished by Elsevier ,2009
- The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewardsNature, 2008
- Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value RepresentationNeuron, 2006
- Neurons in the orbitofrontal cortex encode economic valueNature, 2006