Human Substantia Nigra Neurons Encode Unexpected Financial Rewards
- 13 March 2009
- journal article
- other
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 323 (5920) , 1496-1499
- https://doi.org/10.1126/science.1167342
Abstract
The brain's sensitivity to unexpected outcomes plays a fundamental role in an organism's ability to adapt and learn new behaviors. Emerging research suggests that midbrain dopaminergic neurons encode these unexpected outcomes. We used microelectrode recordings during deep brain stimulation surgery to study neuronal activity in the human substantia nigra (SN) while patients with Parkinson's disease engaged in a probabilistic learning task motivated by virtual financial rewards. Based on a model of the participants' expected reward, we divided trial outcomes into expected and unexpected gains and losses. SN neurons exhibited significantly higher firing rates after unexpected gains than unexpected losses. No such differences were observed after expected gains and losses. This result provides critical support for the hypothesized role of the SN in human reinforcement learning.Keywords
This publication has 24 references indexed in Scilit:
- Midbrain dopamine neurons encode decisions for future actionNature Neuroscience, 2006
- NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and MemoryAnnual Review of Neuroscience, 2006
- Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated ParkinsonismJournal of Cognitive Neuroscience, 2005
- By Carrot or by Stick: Cognitive Reinforcement Learning in ParkinsonismScience, 2004
- Separate Neural Systems Value Immediate and Delayed Monetary RewardsScience, 2004
- Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive StimuliScience, 2004
- l-Dopa medication remediates cognitive inflexibility, but increases impulsivity in patients with Parkinson’s diseasePublished by Elsevier ,2003
- A Neural Substrate of Prediction and RewardScience, 1997
- A Neostriatal Habit Learning System in HumansScience, 1996
- Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuliNature, 1996