Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Top Cited Papers
- 6 November 2005
- journal article
- research article
- Published by Springer Nature in Nature Neuroscience
- Vol. 8 (12) , 1704-1711
- https://doi.org/10.1038/nn1560
Abstract
A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the factors favoring dominance by either system.Keywords
This publication has 44 references indexed in Scilit:
- Complementary memory systems: competition, cooperation and compensationTrends in Neurosciences, 2005
- Separate Neural Systems Value Immediate and Delayed Monetary RewardsScience, 2004
- Dissociable Roles of Ventral and Dorsal Striatum in Instrumental ConditioningScience, 2004
- Amygdala–frontal interactions and reward expectancyCurrent Opinion in Neurobiology, 2004
- Learning and Memory Functions of the Basal GangliaAnnual Review of Neuroscience, 2002
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- A Bayesian approach to relevance in game playingArtificial Intelligence, 1997
- A Neural Substrate of Prediction and RewardScience, 1997
- Feature Article: Distributed Modular Architectures Linking Basal Ganglia, Cerebellum, and Cerebral Cortex: Their Role in Planning and Controlling ActionCerebral Cortex, 1995
- Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and CortexAnnual Review of Neuroscience, 1986