Still at the Choice‐Point
- 1 May 2007
- journal article
- review article
- Published by Wiley in Annals of the New York Academy of Sciences
- Vol. 1104 (1) , 147-171
- https://doi.org/10.1196/annals.1390.006
Abstract
Contrary to classic stimulus-response (S-R) theory, recent evidence suggests that, in instrumental conditioning, rats encode the relationship between their actions and the specific consequences that these actions produce. It has remained unclear, however, how encoding this relationship acts to control instrumental performance. Although S-R theories were able to give a clear account of how learning translates into performance, the argument that instrumental learning constitutes the acquisition of information of the form "response R leads to outcome O" does not directly imply a particular performance rule or policy; this information can be used both to perform R and to avoid performing R. Recognition of this problem has forced the development of accounts that allow the O and stimuli that predict the O (i.e., S-O) to play a role in the initiation of specific Rs. In recent experiments, we have used a variety of behavioral procedures in an attempt to isolate the processes that contribute to instrumental performance, including outcome devaluation, reinstatement, and Pavlovian-instrumental transfer. Our results, particularly from experiments assessing outcome-selective reinstatement, suggest that both "feed-forward" (O-R) and "feed-back" (R-O) associations are critical and that although the former appear to be important to response selection, the latter-together with processes that determine outcome value-mediate response initiation. We discuss a conceptual model that integrates these processes and its neural implementation.Keywords
This publication has 70 references indexed in Scilit:
- Dorsomedial Prefrontal Cortex Resolves Response Conflict in RatsJournal of Neuroscience, 2006
- Indeterminacy in Brain and BehaviorAnnual Review of Psychology, 2005
- Consolidation and Reconsolidation of Incentive Learning in the AmygdalaJournal of Neuroscience, 2005
- Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learningNeuroscience & Biobehavioral Reviews, 2004
- The Interaction between Discriminative Stimuli and Outcomes during Instrumental LearningThe Quarterly Journal of Experimental Psychology, 2003
- Transfer of instrumental control mediated by a devalued outcomeLearning & Behavior, 1994
- Associations between the discriminative stimulus and the reinforcer in instrumental learning.Journal of Experimental Psychology: Animal Behavior Processes, 1988
- Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and CortexAnnual Review of Neuroscience, 1986
- Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.Psychological Review, 1967
- MARRIAGES IN CONSANGUINITYAmerican Journal of Psychiatry, 1859