Distinct error-correcting and incidental learning of location relative to landmarks and boundaries
- 15 April 2008
- journal article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 105 (15) , 5909-5914
- https://doi.org/10.1073/pnas.0711433105
Abstract
Associative reinforcement provides a powerful explanation of learned behavior. However, an unproven but long-held conjecture holds that spatial learning can occur incidentally rather than by reinforcement. Using a carefully controlled virtual-reality object-location memory task, we formally demonstrate that locations are concurrently learned relative to both local landmarks and local boundaries but that landmark-learning obeys associative reinforcement (showing "overshadowing" and "blocking" or "learned irrelevance"), whereas boundary-learning is incidental, showing neither overshadowing nor blocking nor learned irrelevance. Crucially, both types of learning occur at similar rates and do not reflect differences in levels of performance, cue salience, or instructions. These distinct types of learning likely reflect the distinct neural systems implicated in processing of landmarks and boundaries: the striatum and hippocampus, respectively [Doeller CF, King JA, Burgess N (2008) Proc Natl Acad Sci USA 105:5915-5920]. In turn, our results suggest the use of fundamentally different learning rules by these two systems, potentially explaining their differential roles in procedural and declarative memory more generally. Our results suggest a privileged role for surface geometry in determining spatial context and support the idea of a "geometric module," albeit for location rather than orientation. Finally, the demonstration that reinforcement learning applies selectively to formally equivalent aspects of task-performance supports broader consideration of two-system models in analyses of learning and decision making.Keywords
This publication has 52 references indexed in Scilit:
- Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memoryProceedings of the National Academy of Sciences, 2008
- Dopamine-dependent prediction errors underpin reward-seeking behaviour in humansNature, 2006
- The Role of Associative History in Models of Associative Learning: A Selective Review and a Hybrid ModelThe Quarterly Journal of Experimental Psychology, 2004
- Absence of Overshadowing and Blocking between Landmarks and the Geometric Cues Provided by the Shape of a Test ArenaThe Quarterly Journal of Experimental Psychology, 2003
- Hippocampal synaptic plasticity: role in spatial learning or the automatic recording of attended experience?Philosophical Transactions Of The Royal Society B-Biological Sciences, 1997
- A Neural Substrate of Prediction and RewardScience, 1997
- Place navigation in the morris water maze under minimum and redundant extra-maze cue conditionsBehavioral and Neural Biology, 1994
- A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.Psychological Review, 1980
- A theory of attention: Variations in the associability of stimuli with reinforcement.Psychological Review, 1975
- Cognitive maps in rats and men.Psychological Review, 1948