ReviewNeural circuits in auditory and audiovisual memory
Introduction
We frequently rely on auditory working memory, for example, when we hear a phone number, and after a brief pause, successfully recall the number to place the call. We also depend on working memory when our train of thought is interrupted and we effortlessly return to it. Although there is much known about auditory pathways and processing, the underlying neural substrates of auditory working memory are poorly understood. Importantly, we do know that damage to sites within frontal, temporal, and parietal cortices can lead to auditory aphasias and memory deficits (Alain et al., 1998, Goerlich et al., 1995, Goll et al., 2010a, Goll et al., 2010b). Additionally, natural aging, strokes, traumatic brain injury and disease can damage the frontal cortex and impair auditory short-term memory capabilities, which can affect daily life. For example, patients with damage to the ventral frontal cortex suffer from language impairments, problems with auditory comprehension, and difficulties with understanding sentences with complex syntax. These are all functions that rely on auditory working memory (Kummerer et al., 2013, Szczepanski and Knight, 2014). Thus, it is imperative to delineate the neural networks and processes that contribute to auditory working memory.
Working memory is defined in multiple ways. One classic definition describes working memory as a method to control attention through the ‘central executive’, composed of the visuospatial sketchpad, phonological loop, and ‘episodic buffer’ (Baddeley and Hitch, 1974, Baddeley, 2000). These are broad aspects of cognition and assist with decision making, language processing, and reasoning (Duncan, 2010, Friederici and Gierhan, 2013, Miller, 2013). However, for this review we will use another common definition of working memory which is “to hold an item of information ‘in-mind’ for a short period of time and to update information from moment to moment” (Goldman-Rakic, 1996).
It has been suggested that nonhuman primates (NHPs) do not have auditory working memory (Scott et al., 2012, Scott et al., 2013), but possess a much more limited short-term mnemonic ability termed ‘passive short-term memory’. Previous research argues against this point of view. Although NHP׳s auditory memory abilities may be less than their capacities for remembering visual information they have demonstrated the ability to discriminate and remember auditory sounds over several seconds (Plakke et al., 2013), which is, by definition, auditory working memory. Evidence for intermediate to long-term auditory memory comes from the established ability of primates to recognize vocalizations of kin (Rendall et al., 1996) and to respond to conspecific and other primate species alarm calls (Zuberbuhler, 2000). In the natural environment, various primate species are able to utilize syntax-like rules when listening to a complex series of call types and alter their behavior accordingly (Arnold and Zuberbuhler, 2008, Lemasson et al., 2010, Zuberbuhler, 2002). For example, if a Campbell׳s monkey makes an alarm call for an eagle, Diana monkeys will also produce alarm calls signaling eagles; however, if a boom vocalization occurs before the alarm call of the Campbell monkey the Diana monkeys ignores the warning (Zuberbuhler, 2002). The boom vocalization changes the meaning of the subsequent alarm call, and the Diana monkeys recognize this context and do not send out their own alarm calls. Monkeys housed in a laboratory can also recognize the vocalizations of monkeys from their shared housing room (Adachi and Hampton, 2011, Habbershon et al., 2013). The ability to recognize meaningful vocalizations and alter behavior indicates that primates have some form of auditory memory, perhaps even long-term auditory memory for specific callers, and this leaves the door open for the manipulation of auditory information during working memory as well. The various forms of auditory memory (working, short-term, long-term) and the precise neuronal circuits that each form of memory relies on, is still under investigation. For purposes of this review, the ability to recognize matching or nonmatching auditory stimuli, over a period of several seconds, will be considered auditory working memory.
Section snippets
Auditory short-term memory in non-human primates and humans
One reason the mechanisms of auditory memory have not been studied extensively is that it has been difficult to train non-human primates to perform auditory working memory tasks that are similar to those used in the study of visual memory. Nonetheless, there have been some auditory discrimination/memory paradigms used to study the performance of a wide array of species including dogs, dolphins, starlings and non-human primates (Colombo et al., 1990, D׳Amato and Salmon, 1984, Fritz et al., 2005,
A cortical network for auditory working memory
Which cortical regions within the ventral stream are essential for non-spatial auditory working memory? The auditory cortex itself has been shown to undergo plasticity in a variety of auditory learning and memory paradigms across several species including humans (Fritz et al., 2007, Jancke et al., 2001, Menning et al., 2000, Ohl and Scheich, 2005, Schreiner and Polley, 2014, Weinberger, 2015). Evidence from neurophysiological recordings in non-human primates suggests that the auditory cortex is
Auditory working memory in the prefrontal cortex
The areas of the temporal lobe implicated in auditory memory processing project to the prefrontal cortex (Barbas, 1992, Petrides and Pandya, 1988, Plakke and Romanski, 2014, Romanski et al., 1999a, Romanski and Averbeck, 2009) and a large portion of the prefrontal cortex (PFC) is active during listening (Poremba et al., 2003). The projections target a number of areas which might play a role in auditory cognition. Combined anatomy and physiology have been used to study the precise route that
VLPFC is essential for auditory working memory and audiovisual working memory
In comparison to responses of neurons in DLPFC, single neurons in VLPFC respond robustly to complex sounds, including species-specific vocalizations but not to simple stimuli (Romanski and Goldman-Rakic, 2002). FMRI studies in humans (Fecteau et al., 2005) and monkeys (Ortiz-Rios et al., 2015) have confirmed these vocalization responsive regions. Furthermore, VLPFC neurons show selectivity based on the acoustic characteristics of complex sounds when presented during fixation (Romanski et al.,
Acknowledgments
This work was supported by grants from the National Institutes of Health grant (DC: 04845), the Training and Hearing Balance and Spatial Orientation grant (DC: 009974), the Schmitt Program on Integrative Brain Research and the Center for Visual Science.
References (118)
- et al.
A distributed cortical network for auditory sensory memory in humans
Brain Res.
(1998) - et al.
Meaningful call combinations in a non-human primate
Curr. Biol.
(2008) - et al.
Working memory
Psychol. Learn. Motiv.
(1974) The episodic buffer: a new component of working memory?
Trends Cogn. Sci.
(2000)- et al.
Dorsolateral prefrontal contributions to human working memory
Cortex.
(2013) - et al.
Item-nonspecific proactive interference in monkeys׳ auditory short-term memory
Hear. Res.
(2015) - et al.
Recognition of emotional prosody and verbal components of spoken language: an fMRI study
Cogn. Brain Res.
(2000) The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour
Trends Cogn. Sci.
(2010)- et al.
The language network
Curr. Opin. Neurobiol.
(2013) - et al.
Auditory attention – focusing the searchlight on sound
Curr. Opin. Neurobiol.
(2007)
Evidence for dissociation of impairment on auditory discrimination and delayed response following lateral frontal lesions in monkeys
Exp. Neurol.
Prefrontal unit activity of macaque monkeys during auditory and visual reaction time tasks
Brain Res.
Comparison of superior temporal and inferior prefrontal lesions on auditory and non-auditory tasks in rhesus monkeys
Brain Res.
Short-term functional plasticity in the human auditory cortex: an fMRI study
Cogn. Brain Res.
Neither perirhinal/entorhinal nor hippocampal lesions impair short-term auditory recognition memory in dogs
Neuroscience
Interference-based forgetting in verbal short-term memory
J. Mem. Lang.
No temporal decay in verbal short-term memory
Trends Cogn. Sci.
Learning-induced plasticity in animal and human auditory cortex
Curr. Opin. Neurobiol.
Voice cells in the primate temporal lobe
Curr. Biol.
Neural correlates of auditory recognition memory in primate lateral prefrontal cortex
Neuroscience
Functional topography of working memory for face or voice identity
NeuroImage
Mechanisms of forgetting in short-term memory
Cogn. Psychol.
Vocal recognition of individuals and kin in free-ranging rhesus monkeys
Anim. Behav.
Timing of audiovisual inputs to the prefrontal cortex and multisensory integration
Neuroscience
Neurons responsive to face-view in the primate ventrolateral prefrontal cortex
Neuroscience
Prefrontal neurons predict choices during an auditory same-different task
Curr. Biol.
Auditory map plasticity: diversity in causes and consequences
Curr. Opin. Neurobiol.
Neural correlates of auditory short-term memory in rostral superior temporal cortex
Curr. Biol.
Effect of acoustic similarity on short-term auditory memory in the monkey
Hear. Res.
Rhesus monkeys see who they hear: spontaneous cross-modal memory for familiar conspecifics
PloS One
Architecture and cortical connections of the prefrontal cortex in the rhesus monkey
Adv. Neurol.
In search of decay in verbal short-term memory
J. Exp. Psychol. Learn. Mem. Cogn.
Achilles׳ ear? inferior human short-term and recognition memory in the auditory modality
PloS One
Neural correlates of short-term memory in primate auditory cortex
Front. Neurosci.
Auditory memory in monkeys: costs and benefits of proactive interference
Am. J. Primatol.
Auditory proactive interference in monkeys: the roles of stimulus set size and intertrial interval
Learn. Behav.
Auditory memory cells in dorsolateral prefrontal cortex
NeuroReport
Interaction of ventral and orbital prefrontal cortex with inferotemporal cortex in conditional visuomotor learning
Behav. Neurosci.
Activation of broca׳s area by syntactic processing under conditions of concurrent articulation
Hum. Brain Mapp.
Auditory and visual memory in musicians and nonmusicians
Psychon. Bull. Rev.
Auditory recognition memory is inferior to visual recognition memory
Proc. Natl. Acad. Sci. USA
A functional role for the ventrolateral prefrontal cortex in non-spatial auditory cognition
PNAS
The effects of superior temporal cortex lesions on the processing and retention of auditory information in monkeys (cebus apella)
J. Neurosci.
Auditory association cortex lesions impair auditory short-term memory in monkeys
Science
A comparison of visual and auditory short-term memory in monkeys (cebus apella)
Q. J. Exp. Psychol. B
Processing and retention of complex auditory stimuli in monkeys (cebus apella)
Can. J. Psychol.
Disinhibition in pitch memory
Percept. Psychophys.
Responses of prefrontal multisensory neurons to mismatching faces and vocalizations
J. Neurosci.
Sensitivity to voice in human prefrontal cortex
J. Neurophysiol.
In search of an auditory engram
Proc. Natl. Acad. Sci. USA
Cited by (22)
Representation of Expression and Identity by Ventral Prefrontal Neurons
2022, NeuroscienceCitation Excerpt :Hence, they have been described as more “communicative” in nature rather than emotional. Acoustic exemplars of coo vocalizations were also found to carry more information than other acoustic vocalizations in the macaque repertoire in recordings of single VLFPC neurons (Plakke and Romanski, 2016). Using larger stimulus sets and passive viewing, previous studies have described selectivity for particular faces, face-views, objects and vocalizations in VLPFC neurons (O’Scalaidhe et al., 1997, 1999; Romanski et al., 2005; Romanski and Diehl, 2011; Plakke and Romanski, 2016; Constantinidis and Qi, 2018).
Categorical Auditory Working Memory in Crows
2020, iScienceCitation Excerpt :Undoubtedly, also animals that rely on elaborate audio-vocal communication would benefit from this cognitive ability. Unfortunately, most animals are notoriously difficult to train on complex auditory tasks (Plakke and Romanski, 2016). Currently it is therefore rarely studied whether animals can actively maintain auditory categories in working memory (Tsunada et al., 2011).
Scanning acoustic short-term memory: Evidence for two subsystems with different time-course and memory strength
2020, International Journal of PsychophysiologyCitation Excerpt :Moreover, P3 amplitude was found to decrease with an increase in memory load (Pelosi et al., 1992; Starr and Barrett, 1987). Auditory STM involves a large number of brain regions from the auditory cortex to regions in the temporal and frontal cortices, with a critical role of the ventrolateral prefrontal cortex (e.g., see Plakke and Romanski, 2016). Much of the research on auditory STM using the Sternberg task used memory items such as digits (Golob and Starr, 2004), letters (Krause et al., 1996), or environmental sounds (Chao and Knight, 1996).
The Impacts of Simulated Microgravity on Rat Brain Depended on Durations and Regions
2019, Biomedical and Environmental SciencesNot single brain areas but a network is involved in language: Applications in presurgical planning
2018, Clinical Neurology and NeurosurgeryNeural correlates of auditory scale illusion
2016, Hearing Research