Bases and implications of learning in the cerebellum — adaptive control and internal model mechanism

https://doi.org/10.1016/S0079-6123(04)48009-1Get rights and content

Abstract

The cerebellum has a fine compartment structure, which represents various discrete functions. Evolutionarily old, medial parts of the cerebellum are involved in the adaptive control of vairous brainstem and spinal cord functions, and long-term depression (LTD) plays a key role in this adaptive control. To extend these views to evolutionarily newer, lateral parts of the cerebellum involved in cerebral cortical functions such as voluntary movement, perception and language, the internal model hypothesis is instrumental. This hypothesis explains not only the characteristic cerebellar symptom, dysmetria, but also a number of otherwise unexplainable phenomena displayed in movements and mental actions.

Introduction

Investigations of the cerebellum have been greatly advanced during the past century, and several lines of basic knowledge accumulated thus, to provide the basis for understanding the neuronal mechanisms and functional roles of the cerebellum. First, the neuroanatomical studies revealed that the cerebellum has a unique geometrical architecture represented by the checkered board map shown in Fig. 1. It is divided into the middle longitudinal area, vermis, and the intermediate and lateral parts of the hemisphere, which are further subdivided into 13 major longitudinal zones (A in the middle and B, C1, C2, C3, D1 and D2 on the right and left sides) (Groenewegen et al., 1979). At the vermis, grooves running along the right–left axis divide the cerebellum into ten lobules I–X, which continue to the hemisphere as lobules HII–HX (Larsell and Yansen, 1972). While certain divisions are missing in the posterior part of the B, C1 and C3 zones, and there are additional zones such as x in the anterior vermis (Fig. 1), the cerebellum contains more than one hundred divisions.

Second, the cerebellar divisions have uniformly structured neuronal circuits and hence are presumed to operate by the same local circuit principles. The elaborate network structures of the cerebellar cortex composed of the Purkinje, basket, stellate, Golgi and granule cells, and mossy and climbing fiber afferents have been analyzed extensively. More recently, Lugaro cells (see Lane and Axelrod, 2002), unipolar brush cells (see Dino et al., 1999) and serotonergic, noradrenergic, dopaminergic and acetylcholinergic afferents (see Schweighofer et al., 2004) have also been recognized as unique elements of the network. While various types of synaptic plasticity have been located in the network as possible memory elements (Hansel et al., 2001), the long-term depression (LTD) is unique being induced by the convergence of signals from both granule cell axons and climbing fibers to a Purkinje cell. The signal transduction underlying LTD has recently been analyzed extensively (see Ito, 2001, 2002). Earlier, the author proposed a cerebellar corticonuclear microcomplex (hereafter referred to as ‘microcomplex’) as a functional unit capable of learning with LTD as a major memory process (Ito, 1984). A microcomplex is composed of a microzone of the cerebellar cortex interconnected to a small group of cerebellar nuclear neurons (or vestibular nuclear neurons) and a small group of inferior olive neurons that project climbing fiber afferents. A microcomplex modifies the relationship between the input from mossy fiber afferents and the output from nuclear neurons in response to error signals conveyed by the climbing fibers.

Third, these microcomplexes are connected to different extracerebellar structures, and hence are involved in diverse functions. Since a microcomplex has an area of 10 mm2 in the cerebellar cortex, and since the entire cortex has an area of 50,000 mm2, a human cerebellum may contain 5000 microcomplexes (Ito, 1984). A prototype of a cerebellar control has been developed from the manner in which the vermis, including the A and B zones, and the intermediate part of the hemisphere including the C1–C3 zones are connected to the spinal cord and the brainstem. Figure 2 illustrates the involvement of the flocculus in the two-degrees-of-freedom control of the eye movements in response to the head movements and optokinetic stimulation. A relatively small number of specific functions have so far been localized in the cerebellar surface, as illustrated in Fig. 1. Locomotion is represented in the vermis of lobule V (Yanagihara and Udo, 1994) and the C1 and C3 zones of the rostral paramedian lobule (Apps and Lee, 1999), and the saccadic eye movements in the oculomotor vermis covering lobules VI–VIII (Noda and Fujikado, 1987; Barash et al., 1999). A major site involved in the eye-blink conditioning is the C1 and C3 zones of lobule HVI (Attwell et al., 2001). The scheme of adaptive control applies well to the evolutionarily old, medial part of the cerebellum connected to the brainstem and the spinal cord (Ito, 1984; Barlow, 2002). In particular, the vestibuloocular reflex adaptation (Nagao and Ito, 1991; De Zeeuw et al., 1998), eyeblink conditioning (Bao et al., 1998) and locomotion (Ichise et al., 2000) are now widely used as model systems for testing the cerebellar learning function under various pharmacological and genetic manipulations of the cerebellar neuronal circuits.

Fourth, during the course of evolution in vertebrates beyond birds toward humans, the cerebellar hemisphere expanded markedly in association with the development of the cerebral cortex. The cerebellar hemisphere is thus involved in voluntary movements such as pointing with a hand (Kitazawa et al., 1998), visuomotor tracking with a computer mouse (Imamizu et al., 2000) and the hand-grip control (Kawato et al., 2003) (Fig. 1). Furthermore, the posterolateral part of the hemisphere represents language (Petersen et al., 1989; Fiez et al., 1992; Gebhart et al., 2002). In this chapter, the author presents the effort to expand the adaptive control system concepts thus far developed in studies of the evolutionarily old, medial parts of the cerebellum involved in the brainstem and spinal cord functions to the evolutionarily newer, lateral parts of the cerebellum involved in the cerebral cortical functions. To this effort, the internal model mechanism is instrumental. It is still largely hypothetical, but it receives increasing support from neuroanatomy and imaging analyses of human brains and computational studies in robotics. The internal model mechanism explains a number of seemingly unexplainable observations in movements as well as mental actions, covering a broad range of central nervous system functions, and its verification will be a major target for future cerebellar research.

Section snippets

Forward model for voluntary movement

The intermediate part of the hemisphere including the C1–C3 zones, is connected not only to the brainstem and the spinal cord via the projection from the interpositus nucleus to the red nucleus and other nuclei, but also to the cerebral primary motor cortex (hereafter referred to as the motor cortex) via the projection from the interpositus nucleus to the thalamus. Since the motor cortex projects to the cerebellum via certain brainstem nuclei (pontine nuclei, nucleus reticularis tegmenti pontis

Sensory cancellation by prediction

In the above-mentioned mode of a forward model control, internal feedback replaces external feedback and makes the system perform effectively even if the external feedback is unavailable (c replaces b in Fig. 4). In another mode, internal feedback predicts a sensory consequence of a movement and acts to cancel it, which otherwise induces a sensation that disrupts the execution of the movement (c cancels b in Fig. 4). A clear example has been observed in fish cerebellum-like tissues, which

Automatization by the inverse model

After a long practice in motor learning, we become so skillful that we no longer need to be conscious about an executed movement. It often happens that, after a grueling match, Sumo wrestlers remember very little about how they have performed, which suggests that they performed largely automatically. Such skill automatization can be explained, at least in part, based on the forward model (Fig. 4), which enables us to perform a precise movement without paying attention to the consequences of an

Source of instruction signals for a voluntary movement

To complete the control system scheme shown in Fig. 4, Fig. 6, sources should be defined for instruction signals to the motor cortex and the cerebellum, which designate the content of the movement to be performed, for example, a desired trajectory of an arm movement. These instruction signals should come from the cortical areas devoted to motor planning and preparation, directly from the anterior cingulate gyrus (ACG), supplementary motor area (SMA) and premotor area (PMA), and indirectly from

Internal model for mental action

The most lateral part of the hemisphere (D1 and D2 zones) is connected to the cerebral association cortex. In humans these zones expand markedly and have been suggested to be involved not only in motor but also in certain cognitive functions such as language (Leiner et al., 1986). In contrast to the sensory and the motor cortices that receive stimuli from the external environment and send outputs to the external environment, the association cortex contains a self-sufficient internal loop in

Internal models for motor actions

Hitherto, we have discussed the possible mechanisms of voluntary movements and thoughts, separately. However, various motor actions that we daily perform integrate both movements and thoughts. One expects that such a motor action involves not only an internal model of a motor apparatus in the cerebellum (Fig. 4, Fig. 6) but also a movement-related mental model in the association cortex and its internal model in the cerebellum (Figs. 7 and 8). A brain imaging study demonstrated the

Perspectives

The internal model hypothesis of the cerebellum is based on a combination of three lines of approaches to solving problems pertaining the brain and mind: (1) neuroscience of neuronal circuits including synaptic plasticity, (2) system neuroscience based on modern control theories, and (3) mental model in psychology. It broadly covers problems of cognition and conation and, in particular, the mechanisms of physical and mental exercises that automate our behavior. It does not directly cover

Conclusions

The cerebellum has a fine compartment structure, which represents various discrete functions. Evolutionarily old, medial parts of the cerebellum is involved in the adaptive control of various brainstem and spinal cord functions, and long-term depression plays a key role in this adaptive control. To extend these views to evolutionarily newer, lateral parts of the cerebellum involved in cerebral cortical functions such as voluntary movement, perception and language, the internal model hypothesis

References (67)

  • R.I. Nicolson et al.

    Developmental dyslexia; The cerebellar deficit hypothesis

    Trends Neurosci.

    (2001)
  • N. Schweighofer et al.

    Cerebellar aminergic neuromodulation: towards a functional understanding

    Brain Res. Rev.

    (2004)
  • J. Stein et al.

    To see but not to read; the magnocellular theory of dyslexia

    Trends Neurosci.

    (1997)
  • J. Voogd

    The human cerebellum

    J. Chem. Neuroanat.

    (2003)
  • D.M. Wolpert et al.

    Multiple paired forward and inverse models for motor control

    Neural Netw.

    (1998)
  • D. Yanagihara et al.

    Climbing fiber responses in cerebellar vermal Purkinje cells during perturbed locomotion in decerebrate cats

    Neurosci. Res.

    (1994)
  • P.J. Attwell et al.

    Acquisition of eyeblink conditioning is critically dependent on normal function in cerebellar cortical lobule HVI

    J. Neurosci.

    (2001)
  • R. Apps et al.

    Gating of transmission in climbing fibre paths to cerebellar cortical C1 and C3 zones in the rostral paramedian lobule during locomotion in the cat

    J. Physiol. (Lond.)

    (1999)
  • S. Bao et al.

    Impaired eye-blink conditioning in waggler, a mutant mouse with cerebellar BDNF deficiency

    Learn. Mem.

    (1998)
  • S. Barash et al.

    Saccadic dysmetria and adaptation after lesions of the cerebellar cortex

    J. Neurosci.

    (1999)
  • Barlow, J.S. (2002) The Cerebellum and Adaptive Control. Cambridge Univ. Press, Cambridge, England, p....
  • C. Bell et al.

    The generation and subtraction of sensory expectations within cerebellum-like structures

    Brain Behav. Evol.

    (1997)
  • S.J. Blakemore et al.

    Central cancellation of self-produced tickle sensation

    Nat. Neurosci.

    (1998)
  • S.J. Blakemore et al.

    The perception of self-produced sensory stimuli in patients with auditory hallucinations and passivity experiences: evidence for a breakdown in self-monitoring

    Psychol. Med.

    (2000)
  • S.J. Blakemore et al.

    Action prediction in the cerebellum and in the parietal lobe

    Exp. Brain Res.

    (2003)
  • K.J.W. Craik
  • C. Darlot et al.

    Computation of inverse dynamics for the control of movements

    Biol. Cybern.

    (1996)
  • N.R. Dino et al.

    Distribution of unipolar brush cells and other calrectin immunoreactive components in the mammalian cerebellar cortex

    J. Neurocytol.

    (1999)
  • J.C. Eccles
  • S.H. Fatemi et al.

    Purkinje cell size is reduced in cerebellum of patients with autism

    Cell. Mol. Neurobiol.

    (2002)
  • J.A. Fiez et al.

    Impaired non-motor learning and error detection associated with cerebellar damage

    A single case study. Brain

    (1992)
  • P.T. Fox et al.

    Brain correlates of stuttering and syllable production

    A PET performance-correlation analysis. Brain

    (2000)
  • J.M. Fuster

    Executive frontal functions

    Exp. Brain Res.

    (2000)
  • Cited by (0)

    View full text