Abstract
Natural visual scenes are cluttered and contain many different objects that cannot all be processed simultaneously. Therefore, attentional mechanisms are needed to select relevant and to filter out irrelevant information. Evidence from functional brain imaging reveals that attention operates at various processing levels within the visual system and beyond. First, the lateral geniculate nucleus appears to be the first stage in the processing of visual information that is modulated by attention, consistent with the idea that it may play an important role as an early gatekeeper in controlling neural gain. Second, areas at intermediate cortical-processing levels, such as V4 and TEO, appear to be important sites at which attention filters out unwanted information by means of receptive field mechanisms. Third, the attention mechanisms that operate in the visual system appear to be controlled by a distributed network of higher order areas in the frontal and parietal cortex, which generate top-down signals that are transmitted via feedback connections to the visual system. And fourth, the pulvinar of the thalamus may operate by integrating and coordinating attentional functions in concert with the fronto-parietal network, although much needs to be learned about its functional properties. The overall view that emerges from the studies reviewed in this article is that neural mechanisms of selective attention operate at multiple stages in the visual system and beyond and are determined by the visual processing capabilities of each stage. In this respect, attention can be considered in terms of a multilevel selection process.
Article PDF
Similar content being viewed by others
References
Adams, M. M., Hof, P. R., Gattass, R., Webster, M. J., & Ungerleider, L. G. (2000). Visual cortical projections and chemoarchitecture of macaque monkey pulvinar. Journal of Comparative Neurology, 419, 377–393.
Bahcall, D. O., & Kowler, E. (1999). Attentional interference at small spatial separations. Vision Research, 39, 71–86.
Benevento, L. A., & Port, J. D. (1995). Single neurons with both form/color differential responses and saccade-related responses in the nonretinotopic pulvinar of the behaving macaque monkey. Visual Neuroscience, 12, 523–544.
Benevento, L. A., & Standage, G. P. (1983). The organization of projections of the retinorecipient and nonretinorecipient nuclei of the pretectal complex and layers of the superior colliculus to the lateral pulvinar and medial pulvinar in the macaque monkey. Journal of Comparative Neurology, 217, 307–336.
Brefczynski, J. A., & DeYoe, E. A. (1999). A physiological correlate of the “spotlight” of visual attention. Nature Neuroscience, 2, 370–374.
Broadbent, D. (1958). Perception and communication. London: Pergamon.
Cameron, E. L., Tai, J. C., & Carrasco, M. (2002). Covert attention affects the psychometric function of contrast sensitivity. Vision Research, 42, 949–967.
Caputo, G., & Guerra, S. (1998). Attentional selection by distractor suppression. Vision Research, 38, 669–689.
Carrasco, M., Ling, S., & Read, S. (2004). Attention alters appearance. Nature Neuroscience, 7, 308–313.
Cavada, C., & Goldman-Rakic, P. S. (1989). Posterior parietal cortex in rhesus monkey: II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe. Journal of Comparative Neurology, 287, 422–445.
Cave K. R., & Zimmerman J. M. (1997). Flexibility in spatial attention before and after practice. Psychological Science, 8, 399–403.
Chelazzi, L., Duncan, J., Miller, E. K., & Desimone, R. (1998). Responses of neurons in inferior temporal cortex during memory-guided visual search. Journal of Neurophysiology, 80, 2918–2940.
Chen, W., Zhu, X. H., Thulborn, K. R., & Ugurbil, K. (1999). Retinotopic mapping of lateral geniculate nucleus in humans using functional magnetic resonance imaging. Proceedings of the National Academy of Sciences, 96, 2430–2434.
Cheng, A., Eysel, U. T., & Vidyasagar, T. R. (2004). The role of the magnocellular pathway in serial deployment of visual attention. European Journal of Neuroscience, 20, 2188–2192.
Cook, E. P., & Maunsell, J. H. (2002). Attentional modulation of behavioral performance and neuronal responses in middle temporal and ventral intraparietal areas of macaque monkey. Journal of Neuroscience, 22, 1994–2004.
Corbetta, M., Miezin, F. M., Dobmeyer, S., Shulman, G. L., & Petersen, S. E. (1990). Attentional modulation of neural processing of shape, color, and velocity in humans. Science, 248, 1556–1559.
Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience, 3, 201–215.
Crick, F. (1984). Function of the thalamic reticular complex: The searchlight hypothesis. Proceedings of the National Academy of Sciences, 81, 4586–4590.
Cutzu, F., & Tsotsos, J. K. (2003). The selective tuning model of attention: Psychophysical evidence for a suppressive annulus around an attended item. Vision Research, 43, 205–219.
Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193–222.
Desimone, R., Moran, J., Schein, S. J., & Mishkin, M. (1993). A role for the corpus callosum in visual area V4 of the macaque. Visual Neuroscience, 10, 159–171.
Desimone R., & Ungerleider L. G. (1989). Neural mechanisms of visual processing in monkeys. In F. Boller & J. Grafam (Eds.), Handbook of neuropsychology (Vol. 2, pp. 267–299). Amsterdam: Elsevier.
Desimone, R., Wessinger, M., Thomas, L., & Schneider, W. (1990). Attentional control of visual perception: Cortical and subcortical mechanisms. Cold Spring Harbor Symposia on Quantitative Biology, 55, 963–971.
DeWeerd, P., Peralta, M. R., III, Desimone, R., & Ungerleider, L. G. (1999). Loss of attentional stimulus selection after extrastriate cortical lesions in macaques. Nature Neuroscience, 2, 753–758.
Duncan, J. (1996). Cooperating brain systems in selective perception and action. In T. Inui & J. L. McClelland (Eds.), Attention and performance XVI (pp. 549–578). Cambridge, MA: MIT Press.
Eriksen, C. W., & St. James, J. D. (1986). Visual attention within and around the field of focal attention: A zoom lens model. Perception & Psychophysics, 40, 225–240.
Erisir, A., Van Horn, S. C., & Sherman, S. M. (1997). Relative numbers of cortical and brainstem inputs to the lateral geniculate nucleus. Proceedings of the National Academy of Sciences, 94, 1517–1520.
Everling, S., Tinsley, C. J., Gaffan D., & Duncan, J. (2002). Filtering of neural signals by focused attention in the monkey prefrontal cortex. Nature Neuroscience, 5, 671–676.
Gallant, J. L., Shoup, R. E., & Mazer, J. A. (2000). A human extrastriate area functionally homologous to macaque V4. Neuron, 27, 227–235.
Goldman-Rakic, P. S. (1988). Topography of cognition: Parallel distributed networks in primate association cortex. Annual Review of Neuroscience, 11, 137–156.
Guillery, R. W., Feig, S. L., & Lozsádi, D. A. (1998). Paying attention to the thalamic reticular nucleus. Trends in Neurosciences, 21, 28–32.
Harting, J. K., Huerta, M. F., Frankfurter, A. J., Strominger, N. L., & Royce, G. J. (1980). Ascending pathways from the monkey superior colliculus: An autoradiographic analysis. Journal of Comparative neurology, 192, 853–882.
Ito, M., & Gilbert, C. D. (1999). Attention modulates contextual influences in the primary visual cortex of alert monkeys. Neuron, 22, 593–604.
Jones, E. G. (1985). The thalamus. New York. Plenum.
Kanwisher, N., & Wojciulik, E. (2000). Visual attention: Insights from brain imaging. Nature Reviews Neuroscience, 1, 91–100.
Karnath, H. O., Himmelbach, M., & Rorden, C. (2002). The subcortical anatomy of human spatial neglect: Putamen, caudate nucleus and pulvinar. Brain, 125(Pt. 2), 350–360.
Kastner, S. (2004). Towards a neural basis of human visual attention: Evidence from functional brain imaging. In J. Duncan & N. Kanwisher (Eds.), Attention and performance XX (pp. 299–318). Oxford: Oxford University Press.
Kastner, S., DeWeerd, P., Desimone, R., & Ungerleider, L. G. (1998). Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. Science, 282, 108–111.
Kastner, S., DeWeerd, P., Pinsk, M. A., Elizondo, M. I., Desimone, R., & Ungerleider, L. G. (2001). Modulation of sensory suppression: Implications for receptive field sizes in the human visual cortex. Journal of Neurophysiology, 86, 1398–1411.
Kastner, S., Nothdurft, H. C., & Pigarev, I. N. (1999). Neuronal responses to orientation and motion contrast in cat striate cortex. Visual Neuroscience, 16, 587–600.
Kastner, S., O’Connor, D. H., Fukui, M. M., Fehd, H. M., Herwig, U., & Pinsk, M. A. (2004). Functional imaging of the human lateral geniculate nucleus and pulvinar. Journal of Neurophysiology, 91, 438–448.
Kastner, S., Pinsk, M. A., DeWeerd, P., Desimone, R., & Ungerleider, L. G. (1999). Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron, 22, 751–761.
Kastner, S., & Ungerleider, L. G. (2000). Mechanisms of visual attention in the human cortex. Annual Review of Neuroscience, 23, 315–341.
LaBerge, D., & Brown, V. (1989). Theory of attentional operations in shape identification. Psychological Review, 96, 101–124.
LaBerge, D., & Buchsbaum, M. S. (1990). Positron emission tomographic measurements of pulvinar activity during an attention task. Journal of Neuroscience, 10, 613–619.
Lavie, N., & Tsal, Y. (1994). Perceptual load as a major determinant of the locus of selection in visual attention. Perception & Psychophysics, 56, 183–197.
Lu Z. L., & Dosher, B. A. (1998). External noise distinguishes attention mechanisms. Vision Research, 38, 1183–1198.
Luck, S. J., Chelazzi, L., Hillyard, S. A., & Desimone, R. (1997). Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. Journal of Neurophysiology, 77, 24–42.
Martinez, A., Anllo-Vento, L., Sereno, M. I., Frank, L. R., Buxton, R. B., Dubowitz, D. J., Wong, E. C., Hinrichs, H., Heinze, H. J., & Hillyard, S. A. (1999). Involvement of striate and extrastriate visual cortical areas in spatial attention. Nature Neuroscience, 2, 364–369.
Maunsell, J. H., & van Essen, D. C. (1983). The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. Journal of Neuroscience, 3, 2563–2586.
McAdams, C. J., & Maunsell, J. H. (1999). Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. Journal of Neuroscience, 19, 431–441.
Mehta, A. D., Ulbert, I., & Schroeder, C. E. (2000). Intermodal selective attention in monkeys: I. Distribution and timing of effects across visual areas. Cerebral Cortex, 10, 343–358.
Merigan, W. H., & Maunsell, J. H. (1993). How parallel are the primate visual pathways? Annual Review of Neuroscience, 16, 369–402.
Miller, E. K., Gochin, P. M., & Gross, C. G. (1993). Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque by addition of a second stimulus. Brain Research, 616, 25–29.
Moore, T., & Armstrong, K. M. (2003). Selective gating of visual signals by microstimulation of frontal cortex. Nature, 421, 370–373.
Moran, J., & Desimone, R. (1985). Selective attention gates visual processing in the extrastriate cortex. Science, 229, 782–784.
Motter, B. C. (1993). Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. Journal of Neurophysiology, 70, 909–919.
Murray, S. O., & Wojciulik, E. (2004). Attention increases neural selectivity in the human lateral occipital complex. Nature Neuroscience, 7, 70–74.
Nobre, A. C. (2001). The attentive homunculus: Now you see it, now you don’t. Neuroscience & Biobehavioral Reviews, 25, 477–496.
O’Connor, D. H., Fukui, M. M., Pinsk, M. A., & Kastner, S. (2002). Attention modulates responses in the human lateral geniculate nucleus. Nature Neuroscience, 5, 1203–1209.
Pessoa, L., Kastner, S., & Ungerleider, L. G. (2002). Attentional control of the processing of neural and emotional stimuli. Cognitive Brain Research, 15, 31–45.
Petersen, S. E., Robinson, D. L., & Keys, W. (1985). Pulvinar nuclei of the behaving rhesus monkey: Visual responses and their modulation. Journal of Neurophysiology, 54, 867–886.
Petersen, S. E., Robinson, D. L., & Morris, J. D. (1987). Contributions of the pulvinar to visual spatial attention. Neuropsychologia, 25, 97–105.
Pinsk, M. A., Doniger, G. M., & Kastner, S. (2004). Push-pull mechanism of selective attention in human extrastriate cortex. Journal of Neurophysiology, 92, 622–629.
Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3–25.
Rafal, R. D., & Posner, M. I. (1987). Deficits in human visual spatial attention following thalamic lesions. Proceedings of the National Academy of Sciences, 84, 7349–7353.
Recanzone, G. H., & Wurtz, R. H. (2000). Effects of attention on MT and MST neuronal activity during pursuit initiation. Journal of Neurophysiology, 83, 777–790.
Recanzone, G. H., Wurtz, R. H., & Schwarz, U. (1997). Responses of MT and MST neurons to one and two moving objects in the receptive field. Journal of Neurophysiology, 78, 2904–2915.
Rees, G., Frith, C. D., & Lavie, N. (1997). Modulating irrelevant motion perception by varying attentional load in an unrelated task. Sience, 278, 1616–1619.
Rees, G., Wojciulik, E., Clarke, K., Husain, M., Frith, C., & Driver, J. (2000). Unconscious activation of visual cortex in the damaged right hemisphere of a parietal patient with extinction. Brain, 123, 1624–1633.
Ress D., Backus, B. T., & Heeger, D. J. (2000). Activity in primary visual cortex predicts performance in a visual detection task. Nature Neuroscience, 3, 940–945.
Reynolds, J. H., Chelazzi, L., & Desimone, R. (1999). Competitive mechanisms subserve attention in macaque areas V2 and V4. Journal of Neuroscience, 19, 1736–1753.
Reynolds, J. H., & Desimone, R. (1999). The role of neural mechanisms of attention in solving the binding problem. Neuron, 24, 19–29, 111–125.
Reynolds, J. H., Pasternak, T., & Desimone, R. (2000). Attention increases sensitivity of V4 neurons. Neuron, 26, 703–714.
Robinson, D. L., McClurkin, J. W., & Kertzman, C. (1990). Orbital position and eye movement influences on visual responses in the pulvinar nuclei of the behaving macaque. Experimental Brain Research, 82, 235–246.
Robinson, D. L., & Petersen, S. E. (1992). The pulvinar and visual salience. Trends in Neurosciences, 15, 127–132.
Robinson, D. L., Petersen, S. E., & Keys, W. (1986). Saccade-related and visual activities in the pulvinar nuclei of the behaving rhesus monkey. Experimental Brain Research, 62, 625–634.
Roelfsema, P. R., Lamme, V. A., & Spekreijse, H. (1998). Objectbased attention in the primary visual cortex of the macaque monkey. Nature, 395, 376–381.
Schall, J. D., & Thompson, K. G. (1999). Neural selection and control of visually guided eye movements. Annual Review of Neuroscience, 22, 241–259.
Schneider, K. A., & Kastner, S. (2004). Attentional modulation of the human lateral geniculate nucleus and superior colliculus: A highresolution fMRI study. Society for Neuroscience Abstracts, 30, 717.
Sereno, M. I., Dale, A. M., Reppas, J. B., Kwong, K. K., Belliveau, J. W., Brady, T. J., Rosen, B. R., & Tootell, R. B. (1995). Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science, 268, 889–893.
Sherman, S. M. (2001). Tonic and burst firing: Dual modes of thalamocortical relay. Trends in Neurosciences, 24, 122–126.
Sherman, S. M., & Guillery, R. W. (2001). Exploring the thalamus. San Diego: Academic Press.
Sherman, S. M., & Guillery, R. W. (2002). The role of the thalamus in the flow of information to the cortex. Philosophical Transactions of the Royal Society of London: Series B, 357, 1695–1708.
Shipp, S. (2001). Corticopulvinar connections of areas V5, V4, and V3 in the macaque monkey: A dual model of retinal and cortical topographies. Journal of Comparative Neurology, 439, 469–490.
Shipp, S. (2003). The functional logic of cortico-pulvinar connections. Philosophical Transactions of the Royal Society of London: Series B, 358, 1605–1624.
Shipp, S. (2004). The brain circuitry of attention. Trends in Cognitive Sciences, 8, 223–230.
Shiu, L. P., & Pashler, H. (1995). Spatial attention and vernier acuity. Vision Research, 35, 337–343.
Smith, A. T. Singh, K. D., & Greenlee, M. W. (2000). Attentional suppression of activity in the human visual cortex. NeuroReport, 11, 271–277.
Spitzer, H., & Richmond, B. J. (1991). Task difficulty: Ignoring, attending to, and discriminating a visual stimulus yield progressively more activity in inferior temporal neurons. Experimental Brain Research, 83, 340–348.
Standage, G. P., & Benevento, L. A. (1983). The organization of connections between the pulvinar and visual area MT in the macaque monkey. Brain Research, 262, 288–294.
Steinman, B. A., Steinman, S. B., & Lehmkuhle, S. (1997). Transient visual attention is dominated by the magnocellular stream. Vision Research, 37, 17–23.
Tootell, R. B., Hadjikhani, N., Hall, E. K., Marrett, S., Vanduffel, W., Vaughan, J. T., & Dale, A. M. (1998). The retinotopy of visual spatial attention. Neuron, 21, 1409–1422.
Tsotsos, J. K., Culhane, S. M., & Cutzu, F. (2001). From foundational principles to a hierarchical selection circuit for attention. In J. Braun, C. Koch, & J. L. David (Eds.), Visual attention and cortical circuits (pp. 285–306). Cambridge, MA: MIT Press.
Ungerleider, L. G., Desimone, R., Galkin, T. W., & Mishkin, M. (1984). Subcortical projections of area MT in the macaque. Journal of Comparative Neurology, 223, 368–386.
Ungerleider, L. G., Gaffan, D., & Pelak, V. S. (1989). Projections from inferior temporal cortex to prefrontal cortex via the uncinate fascicle in rhesus monkeys. Experimental Brain Research, 76, 473–484.
Ungerleider, L. G., Galkin, T. W. & Mishkin, M. (1983). Visuotopic organization of projections from striate cortex to inferior and lateral pulvinar in rhesus monkey. Journal of Comparative Neurology, 217, 137–157.
Vanduffel, W., Tootell, R. B., & Orban, G. A. (2000). Attentiondependent suppression of metabolic activity in the early stages of the macaque visual system. Cerebral Cortex, 10, 109–126.
Van Essen, D. C., Newsome, W. T., & Bixby, J. L. (1982). The pattern of interhemispheric connections and its relationship to extrastriate visual areas in the macaque monkey. Journal of Neuroscience, 2, 265–283.
Vuilleumier, P., Sagiv, N., Hazeltine, E., Poldrack, R. A., Swick, D., Rafal, R. D., & Gabrieli, J. D. E. (2001). Neural fate of seen and unseen faces in visuospatial neglect: A combined event-related functional MRI and event-related potential study. Proceedings of the National Academy of Sciences, 98, 3495–3500.
Webster, M. J., Bachevalier, J., & Ungerleider, L. G. (1994). Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cerebral Cortex, 4, 470–483.
Wiesel, T. N., & Hubel, D. H. (1966). Spatial and chromatic interactions in the lateral geniculate body of the rhesus monkey. Journal of Neurophysiology, 29, 1115–1156.
Yantis, S., Schwarzbach, J., Serences, J. T., Carlson, R. L., Steinmetz, M. A., Pekar, J. J., & Courtney, S. M. (2002). Transient neural activity in human parietal cortex during spatial attention shifts. Nature Neuroscience, 5, 995–1002.
Yeshurun, Y., & Carrasco, M. (1998). Attention improves or impairs visual performance by enhancing spatial resolution. Nature, 396, 72–75.
Yi, D.-J., Woodman, G. F., Widders, D., Marois, R. & Chun, M. M. (2004). Neural fate of ignored stimuli: Dissociable effects of perceptual and working memory load. Nature Neuroscience, 7, 992–996.
Author information
Authors and Affiliations
Corresponding author
Additional information
This review elaborates on ideas and parts that were published in Kastner (2004). Support was provided by grants from the NIMH (RO1 MH64043, P50 MH62196) and the Whitehall Foundation to S.K. and by an NSF Graduate Research Fellowship to M.A.P.
Rights and permissions
About this article
Cite this article
Kastner, S., Pinsk, M.A. Visual attention as a multilevel selection process. Cognitive, Affective, & Behavioral Neuroscience 4, 483–500 (2004). https://doi.org/10.3758/CABN.4.4.483
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/CABN.4.4.483