INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM
Section snippets
INTRODUCTION
This paper draws together evidence on how information about visual stimuli is represented in the temporal cortical visual areas, and on how representations that are invariant with respect to the position, size and even view of objects are formed. The evidence comes from neurophysiological studies of single neuron activity in primates. It also comes from closely related theoretical studies which consider how the representations may be set up by learning in a multistage cortical architecture. The
Visual Cortical Areas in the Temporal Lobes
Visual pathways project via a number of cortico-cortical stages from the primary visual cortex until they reach the temporal lobe visual cortical areas (Seltzer and Pandya, 1978; Maunsell and Newsome, 1987; Baizer et al., 1991). The inferior temporal visual cortex. area TE, is divided into a set of subareas, and in addition there is a set of different areas in the cortex in the superior temporal sulcus (Seltzer and Pandya, 1978; Baylis et al., 1987) (see Fig. 1). Of these latter areas, TPO
A NETWORK MODEL OF INVARIANT VISUAL OBJECT RECOGNITION
To test and clarify the hypotheses just described about how the visual system may operate to learn invariant object recognition, Wallis and Rolls developed a simulation which implements many of the ideas just described, and is consistent with and based on much of the neurophysiology summarized above. The network simulated, visnet, can perform object, including face, recognition in a biologically plausible way, and after training shows for example translation and view invariance (Wallis et al.,
COMPARISON OF DIFFERENT APPROACHES TO INVARIANT OBJECT RECOGNITION
The findings described in Section 3show that the proposed trace learning mechanism and neural architecture can produce cells with responses selective for stimulus type with considerable position, view and size invariance. We now compare to other approaches the proposal made here and by Rolls (1992b), Rolls (1994), 1995, Rolls (1996a) and investigated by simulation using VisNet, about how the visual cortical areas may solve the problem of forming invariant representations.
The trace rule is local
Acknowledgements
The authors have worked on some of the investigations described here with P. Azzopardi, G.C. Baylis, M. Booth, M. Elliffe, P. Foldiak, M. Hasselmo, C.M. Leonard, G. Littlewort, T.J. Milward, D.I. Perrett, M.J. Tovee and A. Treves, and their collaboration is sincerely acknowledged. The authors are grateful to Dr Peter Foldiak for help and advice in preparing this manuscript, and to Dr Roland Baddeley of the MRC Interdisciplinary Research Centre in Brain and Behaviour at Oxford, and Dr L. Abbott,
References (113)
- et al.
Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey
Brain Res.
(1985) - et al.
Temporal coding in the visual system: new vistas on integration in the nervous system
Trends Neurosci.
(1992) - et al.
The role of expressions and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey
Behav. Brain Res.
(1989) - et al.
Face and voice expression identification and their association with emotional and behavioural changes in patients with frontal lobe damage
Neuropsychologia
(1996) - et al.
Neurons in the amygdala of the monkey with responses selective for faces
Behav. Brain Res.
(1985) - et al.
View-dependent object recognition by monkeys
Curr. Biol.
(1994) - et al.
Visual analysis of body movements by neurons in the temporal cortex of the macaque monkey: a preliminary report
Behav. Brain Res.
(1985) - et al.
Visual neurons responsive to faces
Trends Neurosci.
(1987) Neural organisation of higher visual functions
Curr. Opin. Neurobiol.
(1991)Brain mechanisms for invariant visual recognition and learning
Behav. Proc.
(1994)
Learning mechanisms in the temporal lobe visual cortex
Behav. Brain Res.
Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus
Vision Res.
The responses of neurons in the cortex in the superior temporal sulcus of the monkey to band-pass spatial frequency filtered faces
Vis. Res.
Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey
Brain Res.
Mental rotation and orientation-dependence in shape recognition
Cognit. Psychol.
Representational capacity of face coding in monkeys
Cerebral Cortex
Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques
J. Neurosci.
Single units and sensation: a neuron doctrine for perceptual psychology?
Perception
Finding minimum entropy codes
Neural Computat.
Functional subdivisions of temporal lobe neocortex
J. Neurosci.
Responses of neurons in the inferior temporal cortex in short term and serial recognition memory tasks
Expl Brain Res.
Large competitive networks
Network
Visual topography of area TEO in the macaque
J. Comp. Neurol.
Unmasking visual masking: a look at the “why” behind the veil of the “how”
Psychol. Rev.
Hebbian synapses: biological mechanisms and algorithms
Ann. Rev. Neurosci.
Psychophysical support for a two-dimensional view interpolation theory of object recognition
Proc. natn. Acad. Sci. U.S.A.
Size and location invariance in the visual system
Perception
Four frames suffice: a provisional model of vision and space [see p. 279]
Behav. Brain Sci.
Learning invariance from transformation sequences
Neural Comp.
Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position
Biol. Cybernet.
Inferior temporal cortex and pattern recognition
Expl Brain Res. Suppl.
Object-centered encoding by face-selective neurons in the cortex in the superior temporal sulcus of the monkey
Expl Brain Res.
Dynamic binding in a neural network for shape recognition
Psychol. Rev.
The internal representation of solid shape with respect to vision
Biol. Cybernet.
Cortical correlate of pattern backward masking
Proc. Natn. Acad. Sci.
Visual processing in monkey extrastriate cortex
Ann. Rev. Neurosci.
Cited by (0)
- *
Present address: Max-Planck Institut für biologische Kybernetik, Spemannstrasse 38, 72076 Tübingen, Germany.