Category-selective patterns of neural response in the ventral visual pathway in the absence of categorical information
Introduction
Visual areas involved in object perception form a ventral processing pathway that projects from the occipital toward the temporal lobe (Ungerleider and Mishkin, 1982, Milner and Goodale, 1995). Lesions to these regions of the brain often result in difficulties in the perception and recognition of different categories of objects (McNeil and Warrington, 1993, Moscovitch et al., 1997). Consistent with these neuropsychological reports, neuroimaging studies have shown that discrete regions of the ventral visual pathway are specialized for different categories of objects. For example, while some regions of the ventral visual pathway are more responsive to images of faces than to images of non-face objects (Kanwisher et al., 1997, McCarthy et al., 1997), other regions are selective for images of places (Epstein and Kanwisher, 1998), body parts (Downing et al., 2001) and visually presented words (Cohen et al., 2000). This selectivity has been regarded as characteristic of a modular organization in which distinct regions process specific object categories (Kanwisher, 2010).
Despite the evidence for category-selectivity in the ventral visual pathway, specialized regions have only been reported for a limited number of object categories (Downing et al., 2006, Op de Beeck et al., 2008). However, other studies using multivariate fMRI analysis methods have demonstrated that the spatial pattern of response across the entire ventral stream can distinguish a greater range of object categories (Ishai et al., 1999, Haxby et al., 2001, Kriegeskorte et al., 2008). The distributed nature of the fMRI response to different categories of objects within the ventral visual pathway has been interpreted as showing a topographic map of object form (Haxby et al., 2001).
The topographic organization of the ventral stream is thought to be analogous with the topographic organization found in early visual areas, in which responses are tightly linked to low-level properties of the image, such as spatial frequency, orientation and spatial position (Hubel and Wiesel, 1968, Bonhoeffer and Grinvald, 1991, Engel et al., 1994, Wandell et al., 2007). In contrast to early visual areas, a variety of evidence has suggested that patterns of response in the ventral visual pathway are linked to the categorical or semantic information that the images convey rather than to the image properties (Kriegeskorte et al., 2008, Naselaris et al., 2009, Connolly et al., 2012). Evidence for other organizing principles can be found in the large-scale patterns of response to animacy (Chao et al., 1999, Kriegeskorte et al., 2008) and the real-world size of objects (Konkle and Oliva, 2012). However, it remains unclear how the selectivity for high-level properties in ventral visual pathway might arise from image-based representations found in early visual regions (Op de Beeck et al., 2008). In recent studies, we showed that low-level properties of objects could predict patterns of neural response in the ventral visual pathway (Rice et al., 2014, Watson et al., 2016). However, images drawn from the same object category are likely to have similar low-level properties. So, the link between image properties and patterns of neural response is expected under both categorical and image-based accounts.
The aim of the present study was to directly determine whether the category-selective patterns of neural response across the ventral visual pathway can be explained by selectivity to more basic properties of the stimulus. To address this question, we measured the neural response across the ventral visual pathway to intact images of different object categories, as well as versions of these images that had been phase-scrambled on a global or local basis. Our rationale for using scrambled images is that they have many of the image properties found in intact images, but do not convey any categorical or semantic information, thus providing dissociation between higher-level and lower-level information. Our hypothesis was that, if neurons in the ventral stream are selective for the categorical or semantic properties conveyed by the image, there should be no correspondence between patterns of response evoked by intact and scrambled images. Conversely, if patterns of response in the ventral stream reflect selectivity to more basic dimensions of the stimulus, we would predict a significant correlation between patterns of response to intact and scrambled images.
Section snippets
Stimuli
180 images of five object categories (bottles, chairs, faces, houses, shoes) were taken from an object image stimulus set (Rice et al., 2014). All images were grey-scale, superimposed on a mid-grey background, and had a resolution of 400 × 400 pixels. Images were viewed at a distance of 57 cm and subtended 8° of visual angle. For each original image, two different phase-scrambled versions were generated. A global-scrambling method involved a typical Fourier-scramble, i.e. keeping the global power
Results
First, we conducted a behavioural experiment to determine how image scrambling affected the categorical and semantic information that the images conveyed (Fig. 2). Mean accuracy for globally scrambled (mean = 0.8%, CI: 0.0–2.1%) and locally scrambled (mean = 6.9%, CI: 3.4–10.9%) images was significantly lower than for the intact (mean = 98.4%, CI: 96.6–99.6%) images. Analysis of the confidence ratings for correct answers showed that participants were significantly more confident in their responses to
Discussion
The aim of the present study was to directly determine whether category-selective patterns of response in the ventral stream were better explained by object category or more basic dimensions of the stimulus. To address this issue, we compared patterns of response to intact and scrambled images. Our hypothesis was that, if category-selective patterns of response reflect the categorical or semantic content of the images, there should be little similarity between the patterns of response elicited
References (49)
- et al.
Eccentricity bias as an organizing principle for human high-order object areas
Neuron
(2002) - et al.
A real-world size organization of object responses in occipito-temporal cortex
Neuron
(2012) - et al.
Matching categorical object representations in inferior temporal cortex of man and monkey
Neuron
(2008) - et al.
Bayesian reconstruction of natural images from human brain activity
Neuron
(2009) - et al.
Visual field maps in human cortex
Neuron
(2007) - et al.
Patterns of response to visual scenes are linked to the low-level properties of the image
NeuroImage
(2014) - et al.
Spatial properties of objects predict patterns of neural response in the ventral visual pathway
NeuroImage
(2016) - et al.
Low-level image properties of natural images predict topographic patterns of neural response in the ventral visual pathway
J. Vis.
(2015) - et al.
Retinotopic organization of human ventral visual cortex
J. Neurosci.
(2009) - et al.
Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns
Nature
(1991)
Dissociations and associations between shape and category representations in the two visual pathways
J. Neurosci.
Object ensemble processing in human anterior-medial ventral visual cortex
J. Neurosci.
Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects
Nat. Neurosci.
The visual word form area: spatial and temporal characterization of an initial stage of reading in normal participants and posterior split-brain patients
Brain
The representation of biological classes in the human brain
J. Neurosci.
A cortical area selective for visual processing of the human body
Science
Domain specificity in visual cortex
Cereb. Cortex
Different spatial scales of shape similarity representation in lateral and ventral LOC
Cereb. Cortex
fMRI of human visual cortex
Nature
A cortical representation of the local visual environment
Nature
Metamers of the ventral stream
Nat. Neurosci.
Retinotopic memory is more precise than spatiotopic memory
Proc. Natl. Acad. Sci. U. S. A.
The functional architecture of the ventral temporal cortex and its role in categorization
Nat. Rev. Neurosci.
PyMVPA: a python toolbox for multivariate pattern analysis of fMRI data
Neuroinformatics
Cited by (48)
Does the brain's ventral visual pathway compute object shape?
2022, Trends in Cognitive SciencesRecognition of pareidolic objects in developmental prosopagnosic and neurotypical individuals
2022, CortexCitation Excerpt :Recent studies have shown that differences in image properties of objects can explain a significant amount of the variance in high-level regions of visual cortex (Coggan et al., 2019; Rice et al., 2014; Sormaz, Watson, Smith, Young, & Andrews, 2016; Watson, Hartley, & Andrews, 2014). For example, category-selective patterns of response are still evident when images have been scrambled in a way that preserves some of their visual properties, but removes their semantic properties (Coggan, Baker, & Andrews, 2016; Coggan, Liu, Baker & Andrews, 2016; Long, Yu, & Konkle, 2018; Watson, Hartley, & Andrews, 2017). Similarly, objects from different categories but with similar image properties give rise to similar patterns of response (Coggan et al., 2019).
The emergence of view-symmetric neural responses to familiar and unfamiliar faces
2022, Neuropsychologia