Elsevier

Brain Research

Volume 1640, Part B, 1 June 2016, Pages 278-288
Brain Research

Review
Neural circuits in auditory and audiovisual memory

https://doi.org/10.1016/j.brainres.2015.11.042Get rights and content

Highlights

  • Auditory working memory (WM) is inferior to visual WM in humans and animals.

  • The prefrontal cortex interacts with temporal lobe regions in auditory cognition.

  • Ventral prefrontal cortex is essential for auditory and audiovisual working memory.

Abstract

Working memory is the ability to employ recently seen or heard stimuli and apply them to changing cognitive context. Although much is known about language processing and visual working memory, the neurobiological basis of auditory working memory is less clear. Historically, part of the problem has been the difficulty in obtaining a robust animal model to study auditory short-term memory. In recent years there has been neurophysiological and lesion studies indicating a cortical network involving both temporal and frontal cortices. Studies specifically targeting the role of the prefrontal cortex (PFC) in auditory working memory have suggested that dorsal and ventral prefrontal regions perform different roles during the processing of auditory mnemonic information, with the dorsolateral PFC performing similar functions for both auditory and visual working memory. In contrast, the ventrolateral PFC (VLPFC), which contains cells that respond robustly to auditory stimuli and that process both face and vocal stimuli may be an essential locus for both auditory and audiovisual working memory. These findings suggest a critical role for the VLPFC in the processing, integrating, and retaining of communication information.

This article is part of a Special Issue entitled SI: Auditory working memory.

Introduction

We frequently rely on auditory working memory, for example, when we hear a phone number, and after a brief pause, successfully recall the number to place the call. We also depend on working memory when our train of thought is interrupted and we effortlessly return to it. Although there is much known about auditory pathways and processing, the underlying neural substrates of auditory working memory are poorly understood. Importantly, we do know that damage to sites within frontal, temporal, and parietal cortices can lead to auditory aphasias and memory deficits (Alain et al., 1998, Goerlich et al., 1995, Goll et al., 2010a, Goll et al., 2010b). Additionally, natural aging, strokes, traumatic brain injury and disease can damage the frontal cortex and impair auditory short-term memory capabilities, which can affect daily life. For example, patients with damage to the ventral frontal cortex suffer from language impairments, problems with auditory comprehension, and difficulties with understanding sentences with complex syntax. These are all functions that rely on auditory working memory (Kummerer et al., 2013, Szczepanski and Knight, 2014). Thus, it is imperative to delineate the neural networks and processes that contribute to auditory working memory.

Working memory is defined in multiple ways. One classic definition describes working memory as a method to control attention through the ‘central executive’, composed of the visuospatial sketchpad, phonological loop, and ‘episodic buffer’ (Baddeley and Hitch, 1974, Baddeley, 2000). These are broad aspects of cognition and assist with decision making, language processing, and reasoning (Duncan, 2010, Friederici and Gierhan, 2013, Miller, 2013). However, for this review we will use another common definition of working memory which is “to hold an item of information ‘in-mind’ for a short period of time and to update information from moment to moment” (Goldman-Rakic, 1996).

It has been suggested that nonhuman primates (NHPs) do not have auditory working memory (Scott et al., 2012, Scott et al., 2013), but possess a much more limited short-term mnemonic ability termed ‘passive short-term memory’. Previous research argues against this point of view. Although NHP׳s auditory memory abilities may be less than their capacities for remembering visual information they have demonstrated the ability to discriminate and remember auditory sounds over several seconds (Plakke et al., 2013), which is, by definition, auditory working memory. Evidence for intermediate to long-term auditory memory comes from the established ability of primates to recognize vocalizations of kin (Rendall et al., 1996) and to respond to conspecific and other primate species alarm calls (Zuberbuhler, 2000). In the natural environment, various primate species are able to utilize syntax-like rules when listening to a complex series of call types and alter their behavior accordingly (Arnold and Zuberbuhler, 2008, Lemasson et al., 2010, Zuberbuhler, 2002). For example, if a Campbell׳s monkey makes an alarm call for an eagle, Diana monkeys will also produce alarm calls signaling eagles; however, if a boom vocalization occurs before the alarm call of the Campbell monkey the Diana monkeys ignores the warning (Zuberbuhler, 2002). The boom vocalization changes the meaning of the subsequent alarm call, and the Diana monkeys recognize this context and do not send out their own alarm calls. Monkeys housed in a laboratory can also recognize the vocalizations of monkeys from their shared housing room (Adachi and Hampton, 2011, Habbershon et al., 2013). The ability to recognize meaningful vocalizations and alter behavior indicates that primates have some form of auditory memory, perhaps even long-term auditory memory for specific callers, and this leaves the door open for the manipulation of auditory information during working memory as well. The various forms of auditory memory (working, short-term, long-term) and the precise neuronal circuits that each form of memory relies on, is still under investigation. For purposes of this review, the ability to recognize matching or nonmatching auditory stimuli, over a period of several seconds, will be considered auditory working memory.

Section snippets

Auditory short-term memory in non-human primates and humans

One reason the mechanisms of auditory memory have not been studied extensively is that it has been difficult to train non-human primates to perform auditory working memory tasks that are similar to those used in the study of visual memory. Nonetheless, there have been some auditory discrimination/memory paradigms used to study the performance of a wide array of species including dogs, dolphins, starlings and non-human primates (Colombo et al., 1990, D׳Amato and Salmon, 1984, Fritz et al., 2005,

A cortical network for auditory working memory

Which cortical regions within the ventral stream are essential for non-spatial auditory working memory? The auditory cortex itself has been shown to undergo plasticity in a variety of auditory learning and memory paradigms across several species including humans (Fritz et al., 2007, Jancke et al., 2001, Menning et al., 2000, Ohl and Scheich, 2005, Schreiner and Polley, 2014, Weinberger, 2015). Evidence from neurophysiological recordings in non-human primates suggests that the auditory cortex is

Auditory working memory in the prefrontal cortex

The areas of the temporal lobe implicated in auditory memory processing project to the prefrontal cortex (Barbas, 1992, Petrides and Pandya, 1988, Plakke and Romanski, 2014, Romanski et al., 1999a, Romanski and Averbeck, 2009) and a large portion of the prefrontal cortex (PFC) is active during listening (Poremba et al., 2003). The projections target a number of areas which might play a role in auditory cognition. Combined anatomy and physiology have been used to study the precise route that

VLPFC is essential for auditory working memory and audiovisual working memory

In comparison to responses of neurons in DLPFC, single neurons in VLPFC respond robustly to complex sounds, including species-specific vocalizations but not to simple stimuli (Romanski and Goldman-Rakic, 2002). FMRI studies in humans (Fecteau et al., 2005) and monkeys (Ortiz-Rios et al., 2015) have confirmed these vocalization responsive regions. Furthermore, VLPFC neurons show selectivity based on the acoustic characteristics of complex sounds when presented during fixation (Romanski et al.,

Acknowledgments

This work was supported by grants from the National Institutes of Health grant (DC: 04845), the Training and Hearing Balance and Spatial Orientation grant (DC: 009974), the Schmitt Program on Integrative Brain Research and the Center for Visual Science.

References (118)

  • C.G. Gross et al.

    Evidence for dissociation of impairment on auditory discrimination and delayed response following lateral frontal lesions in monkeys

    Exp. Neurol.

    (1962)
  • S.I. Ito

    Prefrontal unit activity of macaque monkeys during auditory and visual reaction time tasks

    Brain Res.

    (1982)
  • S.D. Iversen et al.

    Comparison of superior temporal and inferior prefrontal lesions on auditory and non-auditory tasks in rhesus monkeys

    Brain Res.

    (1973)
  • L. Jancke et al.

    Short-term functional plasticity in the human auditory cortex: an fMRI study

    Cogn. Brain Res.

    (2001)
  • D.M. Kowalska et al.

    Neither perirhinal/entorhinal nor hippocampal lesions impair short-term auditory recognition memory in dogs

    Neuroscience

    (2001)
  • S. Lewandowsky et al.

    Interference-based forgetting in verbal short-term memory

    J. Mem. Lang.

    (2008)
  • S. Lewandowsky et al.

    No temporal decay in verbal short-term memory

    Trends Cogn. Sci.

    (2009)
  • F.W. Ohl et al.

    Learning-induced plasticity in animal and human auditory cortex

    Curr. Opin. Neurobiol.

    (2005)
  • C. Perrodin et al.

    Voice cells in the primate temporal lobe

    Curr. Biol.

    (2011)
  • B. Plakke et al.

    Neural correlates of auditory recognition memory in primate lateral prefrontal cortex

    Neuroscience

    (2013)
  • P. Rama et al.

    Functional topography of working memory for face or voice identity

    NeuroImage

    (2005)
  • J. Reitman

    Mechanisms of forgetting in short-term memory

    Cogn. Psychol.

    (1971)
  • D. Rendall et al.

    Vocal recognition of individuals and kin in free-ranging rhesus monkeys

    Anim. Behav.

    (1996)
  • L.M. Romanski et al.

    Timing of audiovisual inputs to the prefrontal cortex and multisensory integration

    Neuroscience

    (2012)
  • L.M. Romanski et al.

    Neurons responsive to face-view in the primate ventrolateral prefrontal cortex

    Neuroscience

    (2011)
  • B.E. Russ et al.

    Prefrontal neurons predict choices during an auditory same-different task

    Curr. Biol.

    (2008)
  • C.E. Schreiner et al.

    Auditory map plasticity: diversity in causes and consequences

    Curr. Opin. Neurobiol.

    (2014)
  • B.H. Scott et al.

    Neural correlates of auditory short-term memory in rostral superior temporal cortex

    Curr. Biol.

    (2014)
  • B.H. Scott et al.

    Effect of acoustic similarity on short-term auditory memory in the monkey

    Hear. Res.

    (2013)
  • I. Adachi et al.

    Rhesus monkeys see who they hear: spontaneous cross-modal memory for familiar conspecifics

    PloS One

    (2011)
  • H. Barbas

    Architecture and cortical connections of the prefrontal cortex in the rhesus monkey

    Adv. Neurol.

    (1992)
  • M.G. Berman et al.

    In search of decay in verbal short-term memory

    J. Exp. Psychol. Learn. Mem. Cogn.

    (2009)
  • J. Bigelow et al.

    Achilles׳ ear? inferior human short-term and recognition memory in the auditory modality

    PloS One

    (2014)
  • J. Bigelow et al.

    Neural correlates of short-term memory in primate auditory cortex

    Front. Neurosci.

    (2014)
  • J. Bigelow et al.

    Auditory memory in monkeys: costs and benefits of proactive interference

    Am. J. Primatol.

    (2013)
  • J. Bigelow et al.

    Auditory proactive interference in monkeys: the roles of stimulus set size and intertrial interval

    Learn. Behav.

    (2013)
  • M. Bodner et al.

    Auditory memory cells in dorsolateral prefrontal cortex

    NeuroReport

    (1996)
  • T.J. Bussey et al.

    Interaction of ventral and orbital prefrontal cortex with inferotemporal cortex in conditional visuomotor learning

    Behav. Neurosci.

    (2002)
  • D. Caplan et al.

    Activation of broca׳s area by syntactic processing under conditions of concurrent articulation

    Hum. Brain Mapp.

    (2000)
  • M.A. Cohen et al.

    Auditory and visual memory in musicians and nonmusicians

    Psychon. Bull. Rev.

    (2011)
  • M.A. Cohen et al.

    Auditory recognition memory is inferior to visual recognition memory

    Proc. Natl. Acad. Sci. USA

    (2009)
  • Y.E. Cohen et al.

    A functional role for the ventrolateral prefrontal cortex in non-spatial auditory cognition

    PNAS

    (2009)
  • M. Colombo et al.

    The effects of superior temporal cortex lesions on the processing and retention of auditory information in monkeys (cebus apella)

    J. Neurosci.

    (1996)
  • M. Colombo et al.

    Auditory association cortex lesions impair auditory short-term memory in monkeys

    Science

    (1990)
  • M. Colombo et al.

    A comparison of visual and auditory short-term memory in monkeys (cebus apella)

    Q. J. Exp. Psychol. B

    (1986)
  • M.R. D׳Amato et al.

    Processing and retention of complex auditory stimuli in monkeys (cebus apella)

    Can. J. Psychol.

    (1984)
  • D. Deutsch et al.

    Disinhibition in pitch memory

    Percept. Psychophys.

    (1975)
  • M.M. Diehl et al.

    Responses of prefrontal multisensory neurons to mismatching faces and vocalizations

    J. Neurosci.

    (2014)
  • S. Fecteau et al.

    Sensitivity to voice in human prefrontal cortex

    J. Neurophysiol.

    (2005)
  • J. Fritz et al.

    In search of an auditory engram

    Proc. Natl. Acad. Sci. USA

    (2005)
  • Cited by (22)

    • Representation of Expression and Identity by Ventral Prefrontal Neurons

      2022, Neuroscience
      Citation Excerpt :

      Hence, they have been described as more “communicative” in nature rather than emotional. Acoustic exemplars of coo vocalizations were also found to carry more information than other acoustic vocalizations in the macaque repertoire in recordings of single VLFPC neurons (Plakke and Romanski, 2016). Using larger stimulus sets and passive viewing, previous studies have described selectivity for particular faces, face-views, objects and vocalizations in VLPFC neurons (O’Scalaidhe et al., 1997, 1999; Romanski et al., 2005; Romanski and Diehl, 2011; Plakke and Romanski, 2016; Constantinidis and Qi, 2018).

    • Categorical Auditory Working Memory in Crows

      2020, iScience
      Citation Excerpt :

      Undoubtedly, also animals that rely on elaborate audio-vocal communication would benefit from this cognitive ability. Unfortunately, most animals are notoriously difficult to train on complex auditory tasks (Plakke and Romanski, 2016). Currently it is therefore rarely studied whether animals can actively maintain auditory categories in working memory (Tsunada et al., 2011).

    • Scanning acoustic short-term memory: Evidence for two subsystems with different time-course and memory strength

      2020, International Journal of Psychophysiology
      Citation Excerpt :

      Moreover, P3 amplitude was found to decrease with an increase in memory load (Pelosi et al., 1992; Starr and Barrett, 1987). Auditory STM involves a large number of brain regions from the auditory cortex to regions in the temporal and frontal cortices, with a critical role of the ventrolateral prefrontal cortex (e.g., see Plakke and Romanski, 2016). Much of the research on auditory STM using the Sternberg task used memory items such as digits (Golob and Starr, 2004), letters (Krause et al., 1996), or environmental sounds (Chao and Knight, 1996).

    View all citing articles on Scopus
    View full text