Review
The neural bases of multistable perception

https://doi.org/10.1016/j.tics.2009.04.006Get rights and content

Multistable perception is the spontaneous alternation between two or more perceptual states that occurs when sensory information is ambiguous. Multistable phenomena permit dissociation of neural activity related to conscious perception from that related to sensory stimulation, and therefore have been used extensively to study the neural correlates of consciousness. Here, we review recent work on the neural mechanisms underlying multistable perception and how such work has contributed to understanding the neural correlates of consciousness. Particular emphasis is put on the role of high-level brain mechanisms that are involved in actively selecting and interpreting sensory information, and their interactions with lower-level processes that are more directly concerned with the processing of sensory stimulus properties.

Introduction

Multistable perception occurs when sensory information is ambiguous and consistent with two or more mutually exclusive interpretations. When no additional cues are available that allow perceptual synthesis to converge on one unique interpretation, perception alternates spontaneously every few seconds between two (‘bistable’) or more (‘multistable’) interpretations of the same sensory input. Well-known examples include the Necker cube, Rubin's face-vase illusion, bistable apparent motion and binocular rivalry (Figure 1). Interest in studying multistable perception in human observers has increased with the advent of modern non-invasive brain imaging techniques such as functional magnetic resonance imaging (fMRI) because multistable stimuli allow neural activity related to conscious perception to be distinguished from that related to physical stimulus properties. Moreover, multistable perception can help us understand the constructive neural processes that generate a unified and coherent subjective experience of the world even though the information available is often fragmentary, conflicting or even ambiguous.

A decade ago, a thought-provoking article on the neural basis of multistable perception was published in this journal [1]. Inspired by the first fMRI studies of bistable perception, (see Refs 1, 2 for reviews) and contrasting with the traditional view that spontaneous perceptual reversals are a consequence of antagonistic activity within the visual system (e.g. Refs 3, 4), the authors proposed that ‘reorganizations of activity throughout the visual cortex, concurrent with perceptual reversals, are initiated by higher, largely non-sensory brain centers’ [1]. Since then, hybrid theoretical proposals have emerged, on the basis of behavioural evidence, which conceptualise multistable perception as arising from interactions between low-level (sensory) and high-level (cognitive) processes [5]. In the last decade, the neural mechanisms of binocular rivalry, a special case of perceptual multistability, have been under intense investigation. Similar hybrid models of binocular rivalry that involve different visual processing levels have been proposed 6, 7, 8. Finally, converging evidence from several recent lines of empirical neuroscience suggests a causal role of frontal and parietal cortex in generating perceptual switches in multistability, as previously proposed [1].

Here, we review recent findings addressing the neural mechanisms of different types of multistable perception, including but not limited to binocular rivalry. We incorporate these findings into an integrated view of how different neural processing levels, ranging from early sensory brain structures to non-sensory associative cortices, might interact to give rise to multistable perception, and how these processes are related to conscious perception in general. As most work has studied visual multistability, we focus on the visual system. However, there are striking behavioural similarities with comparable phenomena in other sensory domains (e.g. auditory 9, 10 and tactile multistability [11]). The same or similar mechanisms involved in visual multistable perception might thus also have a role in other sensory domains (Box 1). Our review is structured according to the traditional hierarchical view of visual information processing, starting with subcortical and low-level cortical visual processing. After discussing intermediate processing stages at the level of extrastriate visual areas, we will focus on recent insights into higher-order mechanisms involving frontal and parietal cortices, and their interactions with lower-level sensory brain regions.

Section snippets

Subcortical and early cortical visual processing

Several early electrophysiological studies concluded that neural activity at the anatomically earliest post-retinal visual processing stages, in the lateral geniculate nucleus (LGN) and primary visual cortex (V1), had little or no influence on the resolution of binocular rivalry (see Refs 1, 2 for reviews). Subsequently, blood oxygenation level dependent (BOLD) fMRI studies in humans have repeatedly demonstrated strong effects of binocular rivalry on signals in V1 12, 13, with a close linkage

Extrastriate visual cortex

A fairly congruent picture has emerged of the involvement of extrastriate visual areas, which lie beyond V1 in the visual pathway, in multistable perception. Both electrophysiological binocular rivalry experiments in human and monkey, plus fMRI experiments in humans reveal strong correlations between subjective perception and activity in functionally specialized extrastriate cortex (see Refs 1, 2, 30 for reviews). Recent studies have extended our understanding of the role of extrastriate visual

Parietal and prefrontal cortex

Multistable phenomena can identify neural correlates of conscious perception by characterizing neuronal populations that correlate with perception independently of physical stimulation. Although such studies can, thus, identify neural processes that reflect the contents of conscious perception, they cannot determine how the brain resolves conflict or ambiguities in the sensory input to settle on one of two (or more) mutually exclusive perceptual interpretations. Such an understanding touches

Conclusions

Multistable phenomena have not only helped to elucidate the neural processes underlying perceptual awareness of sensory stimuli but also to shape our view on the constructive nature of visual processing that provides us with unitary perceptual experiences despite many inconsistencies and ambiguities in the sensory input. In contrast to previous models that explicitly contrast ‘low-level’ (e.g. Refs 3, 4) or ‘high-level’ mechanisms [1], we and many others (e.g. Refs 1, 5) now consider

Acknowledgements

A.K. receives support from the Agence Nationale de la Recherche (SPONTACT grant), G.R. from the Wellcome Trust, and P.S. from the German Research Foundation (Emmy-Noether Programme).

References (89)

  • B.N. Pasley

    Subcortical discrimination of unperceived objects during binocular rivalry

    Neuron

    (2004)
  • P. Sterzer

    Electromagnetic responses to invisible face stimuli during binocular suppression

    Neuroimage

    (2009)
  • T.J. Andrews

    Activity in the fusiform gyrus predicts conscious perception of Rubin's vase-face illusion

    Neuroimage

    (2002)
  • A. Kleinschmidt

    The neural structures expressing perceptual hysteresis in visual letter recognition

    Neuron

    (2002)
  • A. Kleinschmidt

    Neural correlates of visual-motion perception as object- or self-motion

    Neuroimage

    (2002)
  • P. Sterzer

    Neural correlates of spontaneous direction reversals in ambiguous apparent visual motion

    Neuroimage

    (2002)
  • J. Pearson et al.

    Sensory memory for ambiguous vision

    Trends Cogn. Sci.

    (2008)
  • J. Pearson

    The functional impact of mental imagery on conscious perception

    Curr. Biol.

    (2008)
  • A. Ishai

    Distributed neural systems for the generation of visual images

    Neuron

    (2000)
  • A.J. Parker et al.

    Neuronal mechanisms for the perception of ambiguous stimuli

    Curr. Opin. Neurobiol.

    (2003)
  • J.V. Haxby

    Distinguishing the functional roles of multiple regions in distributed neural systems for visual working memory

    Neuroimage

    (2000)
  • M. Raemaekers

    Widespread fMRI activity differences between perceptual states in visual rivalry are correlated with differences in observer biases

    Brain Res.

    (2009)
  • A. Kohler

    Deciding what to see: the role of intention and attention in the perception of apparent motion

    Vision Res.

    (2008)
  • R. van Ee

    Voluntary control and the dynamics of perceptual bi-stability

    Vision Res.

    (2005)
  • Y.I. Fishman

    Neural correlates of auditory stream segregation in primary auditory cortex of the awake monkey

    Hear. Res.

    (2001)
  • C. Micheyl

    Perceptual organization of tone sequences in the auditory cortex of awake macaques

    Neuron

    (2005)
  • D. Pressnitzer

    Perceptual organization of sound begins in the auditory periphery

    Curr. Biol.

    (2008)
  • A. Basirat

    Parieto-frontal gamma band activity during the perceptual emergence of speech forms

    Neuroimage

    (2008)
  • R. Blake et al.

    Visual competition

    Nat. Rev. Neurosci.

    (2002)
  • F. Attneave

    Multistability in perception

    Sci. Am.

    (1971)
  • R. Blake

    A neural theory of binocular rivalry

    Psychol. Rev.

    (1989)
  • G.M. Long et al.

    Enduring interest in perceptual ambiguity: alternating views of reversible figures

    Psychol. Bull.

    (2004)
  • A.W. Freeman

    Multistage model for binocular rivalry

    J. Neurophysiol.

    (2005)
  • H.R. Wilson

    Computational evidence for a rivalry hierarchy in vision

    Proc. Natl. Acad. Sci. U. S. A.

    (2003)
  • A. Polonsky

    Neuronal activity in human primary visual cortex correlates with perception during binocular rivalry

    Nat. Neurosci.

    (2000)
  • F. Tong et al.

    Interocular rivalry revealed in the human cortical blind-spot representation

    Nature

    (2001)
  • S.H. Lee

    Traveling waves of activity in primary visual cortex during binocular rivalry

    Nat. Neurosci.

    (2005)
  • J.D. Haynes et al.

    Decoding mental states from brain activity in humans

    Nat. Rev. Neurosci.

    (2006)
  • L. Parkkonen

    Early visual brain areas reflect the percept of an ambiguous scene

    Proc. Natl. Acad. Sci. U. S. A.

    (2008)
  • J. Pearson

    The effects of transcranial magnetic stimulation on visual rivalry

    J. Vis.

    (2007)
  • J.D. Haynes

    Eye-specific effects of binocular rivalry in the human lateral geniculate nucleus

    Nature

    (2005)
  • K. Wunderlich

    Neural correlates of binocular rivalry in the human lateral geniculate nucleus

    Nat. Neurosci.

    (2005)
  • M. Wilke

    Local field potential reflects perceptual suppression in monkey visual cortex

    Proc. Natl. Acad. Sci. U. S. A.

    (2006)
  • N.K. Logothetis

    Neurophysiological investigation of the basis of the fMRI signal

    Nature

    (2001)
  • Cited by (0)

    View full text