Decision theory, reinforcement learning, and the brain
Top Cited Papers
- 1 December 2008
- journal article
- review article
- Published by Springer Nature in Cognitive, Affective, & Behavioral Neuroscience
- Vol. 8 (4) , 429-453
- https://doi.org/10.3758/cabn.8.4.429
Abstract
Decision making is a core competence for animals and humans acting and surviving in environments they only partially comprehend, gaining rewards and punishments for their troubles. Decision-theoretic concepts permeate experiments and computational models in ethology, psychology, and neuroscience. Here, we review a well-known, coherent Bayesian approach to decision making, showing how it unifies issues in Markovian decision problems, signal detection psychophysics, sequential sampling, and optimal exploration and discuss paradigmatic psychological and neural examples of each problem. We discuss computational issues concerning what subjects know about their task and how ambitious they are in seeking optimal solutions; we address algorithmic topics concerning model-based and model-free methods for making choices; and we highlight key aspects of the neural implementation of decision making.Keywords
This publication has 67 references indexed in Scilit:
- Striatal Activity Underlies Novelty-Based Choice in HumansNeuron, 2008
- The Diffusion Decision Model: Theory and Data for Two-Choice Decision TasksNeural Computation, 2008
- Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomesJournal of Vision, 2008
- Plastic Corticostriatal Circuits for Action LearningAnnals of the New York Academy of Sciences, 2007
- Bayesian inference with probabilistic population codesNature Neuroscience, 2006
- Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasksNature Neuroscience, 2006
- Optimal representation of sensory information by neural populationsNature Neuroscience, 2006
- Bayesian integration in sensorimotor learningNature, 2004
- A Neural Substrate of Prediction and RewardScience, 1997
- The analysis of visual motion: a comparison of neuronal and psychophysical performanceJournal of Neuroscience, 1992