Trends in Cognitive Sciences
ReviewDopamine and adaptive memory
Introduction
Memory is essential to behavior, enabling organisms to draw on past experience to improve choices and actions. Much research has focused on how the hippocampus builds accurate memory for past events. Emerging findings indicate that the neurotransmitter dopamine, known to play a key role in motivated behavior, has a direct impact on memory formation in the hippocampus. Here, we review this emerging literature that demonstrates that interactions between midbrain dopamine regions and the hippocampus promote memory for episodes that are rewarding and novel and build memory representations well-suited to guide later choices. By integrating findings from both human and animal research, we argue for a framework in which dopamine helps create enriched mnemonic representations of the environment to support adaptive behavior.
Section snippets
The hippocampus: Creating building blocks for memory-guided behavior
After decades of research, our understanding of the brain mechanisms that contribute to long-term memory for events or episodes – often referred to as episodic memory – has evolved significantly. Episodic memories are formed rapidly (after even a single experience) and are rich in contextual details. Episodic memories are also thought to be relational: they encode relationships between multiple elements of an event 1, 2. Extensive converging evidence indicates that episodic memory depends
Brain systems for learning and motivation
Converging evidence indicates that the release of dopamine signals motivationally important events and behaviors. Key findings come from a series of seminal neurophysiology studies of dopamine-containing midbrain neurons in primates receiving reward (for a review see [13]). In these studies, a monkey receives a reward (e.g. juice), which is predicted by a cue (e.g. a tone). Dopamine neurons respond with a burst of activity – often referred to as a phasic response – when the monkey unexpectedly
Dopamine modulates hippocampal memories
Much of the evidence for the role of dopamine in modulating hippocampal function comes from anatomical and electrophysiological studies in animals. Midbrain dopamine neurons project directly to the hippocampus and to the surrounding MTL cortices 24, 25 (Figure 2; see Table I in Box 2). Indeed, in animals, dopamine seems to be essential for hippocampal long-term memory. Studies in animals indicate that dopamine acting at hippocampal synapses is a necessary precursor not only for long-term
Dopamine modulates hippocampal memories over a range of timescales
Interestingly, the role of dopamine in supporting the formation of memories extends over a range of timescales: before, during, and after an event. As discussed in the next section, this broad range of timescales implies a similarly broad range of neurobiological mechanisms by which midbrain dopamine neurons can exert an effect on memory formation in the hippocampus.
Initial evidence highlighted the time period before an event as a window during which the presence of dopamine is crucial.
Putative neurobiological mechanisms: Tonic vs. phasic dopamine
The precise mechanisms whereby dopamine modulates memory formation in the hippocampus are not yet known. Nevertheless, existing findings point to a potentially important role for tonic responses in dopamine neurons. In particular, animal research indicates that hippocampal activity originating in the subiculum disinhibits midbrain dopamine neurons, thus increasing the number of tonically active cells, but does not produce phasic responses in individual neurons [63]. As detailed below, this key
Concluding remarks
To summarize, extensive evidence indicates that dopamine release before, during, and after an event supports hippocampal plasticity and episodic memory formation. Dopamine thus seems to influence which episodic memories are formed and how they are represented, enabling memory for past experience to support future adaptive behavior. We use the term ‘adaptive memory’ as a construct for this process to highlight the selectivity of memory and to consider whether this selectivity, which can seem
Acknowledgements
The authors are grateful to Lauren Atlas, Nathan Clement, Lila Davachi, Juliet Davidow, Karin Foerde, Elizabeth Johnson, Jeff Macinnes, Vishnu Murty, and G. Elliott Wimmer for insightful comments on an earlier draft.
References (99)
Item, context and relational episodic encoding in humans
Curr. Opin. Neurobiol.
(2006)- et al.
Observing the transformation of experience into memory
Trends. Cogn. Sci.
(2002) Trial outcome and associative learning signals in the monkey hippocampus
Neuron
(2009)- et al.
Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions
Neuron
(2010) - et al.
Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events
Neuron
(2008) - et al.
The computational neurobiology of learning and reward
Curr. Opin. Neurobiol.
(2006) What is reinforced by phasic dopamine signals?
Brain Res. Rev.
(2008)Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat
Brain Res. Bull.
(1994)Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices
Brain Res.
(1990)Modulation of extracellular monoamine transmitter concentrations in the hippocampus after weak and strong tetanization of the perforant path in freely moving rats
Brain Res.
(2009)
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Neuron
Basal ganglia and dopamine contributions to probabilistic category learning
Neurosci. Biobehav. Rev.
Intracranial EEG correlates of expectancy and memory formation in the human hippocampus and nucleus accumbens
Neuron
Mesolimbic interaction of emotional valence and reward improves memory formation
Neuropsychologia
Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds
Curr. Biol.
Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation
Neuron
The novelty exploration bonus and its attentional modulation
Neuropsychologia
Reward-motivated learning: mesolimbic activation precedes memory formation
Neuron
Heterosynaptic co-activation of glutamatergic and dopaminergic afferents is required to induce persistent long-term potentiation
Neuropharmacology
Rewarded outcomes enhance reactivation of experience in the hippocampus
Neuron
Functional imaging of the human dopaminergic midbrain
Trends Neurosci.
Epistasis between dopamine regulating genes identifies a nonlinear response of the human hippocampus during memory tasks
Biol. Psychiatry
L-dopa impairs learning, but spares generalization, in Parkinson's disease
Neuropsychologia
Dopamine increases in striatum do not elicit craving in cocaine abusers unless they are coupled with cocaine cues
Neuroimage
Interaction between the amygdala and the medial temporal lobe memory system predicts better memory for emotional events
Neuron
How do memory systems interact? Evidence from human classification learning
Neurobiol. Learn. Mem.
Complementary memory systems: competition, cooperation and compensation
Trends Neurosci.
An fMRI study of reward-related probability learning
Neuroimage
Dopamine D5 receptors of rat and human brain
Neuroscience
Strain differences in the distribution of dopamine transporter sites in rat brain
Prog. Neuropsychopharmacol. Biol. Psychiatry
Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity
Brain Res.
From Conditioning to Conscious Recollection: Memory Systems of the Brain
Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans
Psychol. Rev.
Loss of recent memory after bilateral hippocampal lesions
J. Neurol. Neurosurg. Psychiatry
Cognitive neuroscience of human memory
Annu. Rev. Psychol.
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
J. Neurosci.
Patients with hippocampal amnesia cannot imagine new experiences
Proc. Natl. Acad. Sci. U. S. A.
The cognitive neuroscience of constructive memory: remembering the past and imagining the future
Philos. Trans. R. Soc. Lond. B Biol. Sci.
Predictive reward signal of dopamine neurons
J. Neurophysiol.
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Nature
Avoiding negative outcomes: tracking the mechanisms of avoidance learning in humans during fear conditioning
Front. Behav. Neurosci.
Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses
Front. Behav. Neurosci.
Why don’t we move faster? Parkinson's disease, movement vigor, and implicit motivation
J. Neurosci.
The debate over dopamine's role in reward: the case for incentive salience
Psychopharmacology
Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Psychopharmacology
Tonic dopamine: opportunity costs and the control of response vigor
Psychopharmacology.
A role for mesencephalic dopamine in activation: commentary on Berridge (2006)
Psychopharmacology
Catecholaminergic innervation of the hippocampus in the cynomolgus monkey
J. Comp. Neurol.
D1/D5 dopamine receptors inhibit depotentiation at CA1 synapses via cAMP-dependent mechanism
J. Neurosci.
Cited by (457)
The association of positive emotions with absenteeism and presenteeism in Japanese workers
2024, Journal of Affective DisordersPrediction error and memory across the lifespan
2023, Neuroscience and Biobehavioral ReviewsMaterial incentive motivation and working memory performance of kindergartners: A large-scale randomized controlled trial
2023, Journal of Experimental Child PsychologyParameters of prediction: Multidimensional characterization of top-down influence in visual perception
2023, Neuroscience and Biobehavioral Reviews
- *
This article represents a collaborative effort based on equal contributions from both authors; the listing order was determined randomly.