ReviewThe role of the basal ganglia in learning and memory: Insight from Parkinson’s disease
Highlights
► The basal ganglia contribute to specific kinds of learning and memory. ► Parkinson’s disease is a useful model of the basal ganglia’s role in human learning. ► Findings across species lead to novel insights into basal ganglia learning mechanisms. ► Basal ganglia and medial temporal lobe system functions are often contrasted. ► Current theories emphasize computations, rather than verbalizability, of each system.
Introduction
Research on the neurobiology of learning and memory has lead to the proposal that different forms of memory are supported by different brain structures. A focus of research within this framework is to determine which structures contribute to which mnemonic processes; for example, double dissociation studies aim to tease apart unique patterns of brain activity in response to different tasks. The division of long-term memory into declarative and non-declarative processes has been one such fruitful dissociation (Cohen and Eichenbaum, 1993, Gabrieli, 1998, Knowlton et al., 1996, Squire and Zola, 1996).
This basic division of mnemonic function has provided a powerful framework for understanding the organization of memory in the brain. It has led to major advances in understanding the role of the medial temporal lobes in declarative memory and has indicated a separate role for the basal ganglia in habit learning, a form of non-declarative memory. However, by defining the role of the basal ganglia in contrast to that of the medial temporal lobe, the framework has left many important questions unanswered: What are the mechanisms by which learning takes place in the basal ganglia and in its subregions? What are the factors that modulate such learning? Do the basal ganglia and medial temporal lobes operate as independent systems, or do they interact?
Researchers have just begun to address these questions, stimulated by a convergence of evidence from systems and computational neuroscience regarding the role of the basal ganglia (primarily the dorsal and ventral striatum) and their dopaminergic inputs in learning to predict rewards and acting to obtain them. Here, we review these recent advances with an eye towards providing an integrated account of the role of the basal ganglia in learning, a role where the basal ganglia not only acts independently from other brain regions, but also in interaction with them.
Section snippets
Multiple memory systems: understanding the role of the basal ganglia
Extensive converging evidence indicates that long-term memory is not unitary, but instead consists of multiple cognitive processes that rely on discrete neural systems and are governed by distinct learning rules and forms of plasticity (Gabrieli, 1998, Squire and Zola, 1996, White and McDonald, 2002). This concept, often referred to as the multiple memory systems framework, originated from neuropsychological research with patients with specific patterns of brain damage. As discovered with the
The basal ganglia, dopamine, and reward learning
Significant advances have been made in recent years into the functional neurophysiological, neurochemical, and neurocomputational characteristics of the basal ganglia and their dopaminergic inputs. Collectively, these studies suggest that dopamine neurons projecting to the basal ganglia are critical for learning to predict rewarding outcomes and acting to obtain them.
This idea arose from a series of pivotal studies that reported on recordings from dopamine neurons in monkeys and demonstrated a
An integrated view of the basal ganglia in learning
Theories regarding the role of dopamine in reward prediction have had a substantial impact on understanding the role of the basal ganglia in learning. They shed light on the basis for previous inconsistencies and highlight the neural mechanisms that bridge seemingly disparate findings. Integrating the domains of electrophysiology, neuroimaging, computational modeling, and neuropsychology has led to some general principles regarding the role of the basal ganglia in learning, as detailed below.
Interactions between the basal ganglia and other brain systems for learning
Neuropsychological and animal data, together with reinforcement learning models, have provided a detailed understanding of the circumstances under which the basal ganglia support learning and insights into the mechanisms by which they do so. Armed with this new understanding, there has been a renewed interest in understanding how this learning system is complemented by, and interacts with, other learning systems. These efforts have taken place in three main areas:
Conclusions and future directions
Volumes of research have highlighted the unique contributions of the basal ganglia and medial temporal lobes to learning and memory. However, some of the resulting characterizations, such as assigning implicit and explicit learning and memory to these systems, have turned out to be oversimplified. Moreover, a focus on assigning unique attributes to these two systems has overlooked the many ways in which these brain regions jointly contribute to behavior. Converging evidence from
Acknowledgments
We thank Suzanne Wood for comments on an earlier draft and members of the Learning Lab at Columbia University for helpful conversations about the research reviewed here. K.F. is supported by an NINDS NRSA training grant (F32 NS063632); D.S. is supported by a NARSAD Young Investigator Award, the Michael J Fox Foundation, and a National Science Foundation Early Career Award.
References (169)
- et al.
Reward-motivated learning: Mesolimbic activation precedes memory formation
Neuron
(2006) - et al.
Brain dopamine and the syndromes of Parkinson and Huntington. Clinical, morphological and neurochemical correlations
Journal of the Neurological Sciences
(1973) - et al.
Intra-hippocampal lidocaine injections impair acquisition of a place task and facilitate acquisition of a response task in rats
Behavioral Brain Research
(2003) - et al.
Double dissociation between familiarity and recollection in Parkinson’s disease as a function of encoding tasks
Neuropsychologia
(2010) - et al.
Reversal learning in Parkinson’s disease depends on medication status and outcome valence
Neuropsychologia
(2006) Item, context and relational episodic encoding in humans
Current Opinion in Neurobiology
(2006)- et al.
Pharmacological characterization of dopamine systems in the nucleus accumbens core and shell
Neuroscience
(1992) - et al.
Distinct contribution of the cortico-striatal and cortico-cerebellar systems to motor skill learning
Neuropsychologia
(2003) - et al.
Role of the striatum, cerebellum, and frontal lobes in the learning of a visuomotor sequence
Brain and Cognition
(1997) - et al.
Role of the striatum, cerebellum and frontal lobes in the automatization of a repeated visuomotor sequence of movements
Neuropsychologia
(1998)
NOvelty-related motivation of anticipation and exploration by dopamine (NOMAD): Implications for healthy aging
Neuroscience and Biobehavioral Reviews
Functional imaging of the human dopaminergic midbrain
Trends in Neurosciences
Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices
Brain Research
Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat
Brain Research Bulletin
The basal ganglia and chunking of action repertoires
Neurobiology of Learning and Memory
Complementary memory systems: Competition, cooperation and compensation
Trends in Neurosciences
Dissociating habit and recollection: Evidence from Parkinson’s disease, amnesia and focal lesion patients
Neuropsychologia
Differential roles of the frontal cortex, basal ganglia, and cerebellum in visuomotor sequence learning
Neurobiology of Learning and Memory
The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum
Neuroscience
Distinct contribution of the striatum and cerebellum to motor learning
Brain and Cognition
The hippocampal-VTA loop: Controlling the entry of information into long-term memory
Neuron
Basal ganglia output and cognition: Evidence from anatomical, behavioral, and clinical studies
Brain and Cognition
Attentional requirements of learning: Evidence from performance measures
Cognitive Psychology
Temporal difference models and reward-related learning in the human brain
Neuron
Visuospatial memory deficits at different stages of Parkinson’s disease
Neuropsychologia
Instrumental responding following reinforcer devaluation
Quarterly Journal of Experimental Psychology
Regional brain activation during concurrent implicit and explicit sequence learning
Cerebral Cortex
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Annual Review of Neuroscience
Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning
Journal of Neurophysiology
Category learning deficits in Parkinson’s disease
Neuropsychology
Age-related cognitive deficits mediated by changes in the striatal dopamine system
American Journal of Psychiatry
Pattern separation in the human hippocampal CA3 and dentate gyrus
Science
Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action
Neuropsychopharmacology
Advance-cueing produces enhanced action-boundary patterns of spike activity in the sensorimotor striatum
Journal of Neurophysiology
Interruption of a basal ganglia-forebrain circuit prevents plasticity of learned vocalizations
Nature
Tonic dopaminergic stimulation impairs associative learning in healthy subjects
Neuropsychopharmacology
Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli
Proceedings of the National Academy of Sciences of the United States of America
The scope of preserved procedural memory in amnesia
Brain
Switching memory systems during learning: Changes in patterns of brain acetylcholine release in the hippocampus and striatum in rats
Journal of Neuroscience
Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage
Nature Neuroscience
Dissociation between striatal regions while learning to categorize via feedback and via observation
Journal of Cognitive Neuroscience
Connectivity-based segregation of the human striatum predicts personality characteristics
Nature Neuroscience
Memory
Enhanced or impaired cognitive function in Parkinson’s disease as a function of dopaminergic medication and task demands
Cerebral Cortex
Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration
Journal of Neuroscience
L-dopa disrupts activity in the nucleus accumbens during reversal learning in Parkinson’s disease
Neuropsychopharmacology
Attentional and nonattentional forms of sequence learning
Journal of Experimental Psychology: Learning, Memory, & Cognition.
BOLD responses reflecting dopaminergic signals in the human ventral tegmental area
Science
Triple dissociation in the medial temporal lobes: Recollection, familiarity, and novelty
Journal of Neurophysiology
Cited by (141)
Age-Related Alterations in Gray Matter Microstructure in Older People With Remitted Major Depression at Risk for Dementia
2024, Biological Psychiatry Global Open ScienceFunctionality of bioactive lipids in cognitive function
2022, Bioactive LipidsPsychological aspects in unidentified anomalous phenomena (UAP) witnesses
2023, International Journal of Astrobiology