Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine
- 22 November 2006
- journal article
- review article
- Published by Springer Nature in Psychopharmacology
- Vol. 191 (3) , 483-495
- https://doi.org/10.1007/s00213-006-0626-6
Abstract
Throughout our lives we constantly assess the costs and benefits of the possible future outcomes of our actions and use this information to guide behavior. There is accumulating evidence that dopamine contributes to a fundamental component of this computation—how rewards are compared with the costs incurred when obtaining them. We review the evidence for dopamine’s role in cost–benefit decision making and outline a simple mathematical framework in which to represent the interactions between rewards, costs, behavioral state and dopamine. Dopamine’s effects on cost–benefit decision making can be modeled using simple utility–function curves. This approach provides a useful framework for modeling existing data and generating experimental hypotheses that can be objectively and quantitatively tested by observing choice behavior without the necessity to account for subjective psychological states such as pleasure or desire. We suggest that dopamine plays a key role in overcoming response costs and enabling high-effort behaviors. A particularly important anatomical site of this action is the core of the nucleus accumbens. Here, dopamine is able to modulate activity originating from the frontal cortical systems that also assess costs and rewards. Internal deprivation states (e.g., hunger and thirst) also help to energize goal-seeking behaviors, probably in part by their rich influence on dopamine, which can in turn modify decision making policies.Keywords
This publication has 112 references indexed in Scilit:
- Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision makingPublished by Elsevier ,2006
- Expression of ghrelin receptor mRNA in the rat and the mouse brainJournal of Comparative Neurology, 2005
- Double Dissociation between Serotonergic and Dopaminergic Modulation of Medial Prefrontal and Orbitofrontal Cortex during a Test of Impulsive ChoiceCerebral Cortex, 2005
- Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making.Behavioral Neuroscience, 2005
- Contrast enhancement: a physiological effect of striatal dopamine?Cell and tissue research, 2004
- Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learningNeuroscience & Biobehavioral Reviews, 2004
- Parsing rewardPublished by Elsevier ,2003
- Discrete Coding of Reward Probability and Uncertainty by Dopamine NeuronsScience, 2003
- Interaction of CRH and energy balance in the modulation of brain stimulation reward.Behavioral Neuroscience, 2002
- A Neural Substrate of Prediction and RewardScience, 1997