Elsevier

Neurobiology of Disease

Volume 83, November 2015, Pages 191-198
Neurobiology of Disease

Review
Restoring tactile and proprioceptive sensation through a brain interface

https://doi.org/10.1016/j.nbd.2014.08.029Get rights and content

Abstract

Somatosensation plays a critical role in the dexterous manipulation of objects, in emotional communication, and in the embodiment of our limbs. For upper-limb neuroprostheses to be adopted by prospective users, prosthetic limbs will thus need to provide sensory information about the position of the limb in space and about objects grasped in the hand. One approach to restoring touch and proprioception consists of electrically stimulating neurons in somatosensory cortex in the hopes of eliciting meaningful sensations to support the dexterous use of the hands, promote their embodiment, and perhaps even restore the affective dimension of touch. In this review, we discuss the importance of touch and proprioception in everyday life, then describe approaches to providing artificial somatosensory feedback through intracortical microstimulation (ICMS). We explore the importance of biomimicry – the elicitation of naturalistic patterns of neuronal activation – and that of adaptation – the brain's ability to adapt to novel sensory input, and argue that both biomimicry and adaptation will play a critical role in the artificial restoration of somatosensation. We also propose that the documented re-organization that occurs after injury does not pose a significant obstacle to brain interfaces. While still at an early stage of development, sensory restoration is a critical step in transitioning upper-limb neuroprostheses from the laboratory to the clinic.

Introduction

One approach to restoring sensorimotor function to amputees or tetraplegic patients is to equip them with robotic prosthetic arms and have them control these limbs using signals from the motor parts of their brain. To date, a number of patients have been able to control anthropomorphic robotic arms to perform simple motor tasks, such as grasping and moving objects (Collinger et al., 2013, Hochberg et al., 2012). As impressive as these feats are from a scientific and technological standpoint, however, movements generated using these prosthetic limbs are slow and relatively inaccurate; their performance still does not warrant the highly invasive surgery that they would require if they were adopted in the clinic. One important reason for the poor performance is the lack of somatosensory feedback. Indeed, our ability to grasp and manipulate objects is critically dependent on the senses of touch and proprioception. Tactile and proprioceptive signals from the hand convey information about the size, shape, and texture of objects, and indicate when objects are slipping from our grasp (Johansson and Flanagan, 2009). Proprioceptive signals also convey information about the state of our limb and are important to plan and guide movements (Sainburg et al., 1993, Sainburg et al., 1995). Vision is a poor substitute for touch and proprioception as evidenced by the fact that patients with intact motor but impaired somatosensory function struggle to perform activities of daily living, like tying a shoelace or turning a doorknob (Marsden et al., 1984). Touch also plays a critical role in emotional and social communication – we touch the people we care about – and in embodiment – the sense that our body is part of us. Given the importance of somatosensation in intact individuals, a key to improving the performance of prosthetic arms is to incorporate this critical sensory feedback. One approach to restoring somatosensation is to electrically stimulate the somatosensory parts of the brain, specifically primary somatosensory cortex (Fig. 1), in the hopes of eliciting meaningful and informative tactile percepts that can then be used not only to improve the dexterity of these limbs, but also to restore the affective component of touch and promote the embodiment of the prosthesis.

Section snippets

Somatosensation and dexterous motor control

When we grasp and manipulate objects, tactile and proprioceptive signals from our hands convey information about the shape, size, and texture of the objects, and signal when they are slipping from our grasp (Johansson and Flanagan, 2009). A variety of different cutaneous receptors convey information about skin deformations (Bensmaia and Tillery, 2013), and different receptors in the joints, muscles, and skin convey information about the conformation and movements of the limb (Edin, 1990, Edin,

Touch and affective communication

The manner in which we touch someone, for example the speed at which we stroke them, can communicate distinct emotions, such as anger, fear, sadness, love and so on, and the accuracy with which this emotional information is transmitted by touch is comparable to that of vocal and facial expression (Hertenstein et al., 2009). At the somatosensory periphery, pleasant touch is in part mediated by a specialized set of afferents, namely C-tactile afferents, that innervate the hairy skin (Löken et

Touch and embodiment

We experience our limbs as being part of our body; in fact, this embodiment does not necessarily disappear when we lose a limb. Indeed, many amputees experience a phantom limb, the sensation that the missing limb is still there (Ramachandran and Hirstein, 1998). Most patients report that the phantom limb is in a static position and immovable. These sensations can gradually fade over a period of weeks but about 30% of those who experience phantom limbs do so for years or even decades after limb

Electrical stimulation of S1 results in somatosensory percepts

Beginning in the 1930s, Wilder Penfield stimulated the surface of the brain in search of the foci of epileptic seizures (Penfield and Boldrey, 1937) and found that stimulating the postcentral gyrus elicited tactile percepts that were localized to specific locations on the body. These electrically-induced percepts usually manifested as numbness or tingling and sometimes pain. The projected location of these sensations varied systematically with the location of S1 stimulation, leading to the

Biomimicry

The most straightforward approach to conveying artificial sensory feedback is to attempt to reproduce naturalistic patterns of neuronal activation through ICMS. Indeed, different neuronal populations in S1 convey different information about the state of the limb and about events impinging on it. Some neurons convey information about the shape of objects grasped in the hand (Bensmaia et al., 2008) (Fig. 1b), others convey information about the motion of objects across the skin (Pei et al., 2010,

Adaptation

The idea behind the biomimetic approach is that reproducing naturalistic patterns of neuronal activity through ICMS will elicit verisimilar percepts that will be intuitive and therefore will not require the patient to learn to interpret the artificial sensations. The problem with the biomimetic approach is that electrical stimulation of neuronal tissue does not produce naturalistic patterns of neuronal activity; in fact, the effects of ICMS on neurons is ill-understood and difficult to predict.

Contributions of biomimicry and adaptation

The biomimetic and adaptation approaches are not mutually exclusive and indeed are complementary. Studies with biomimetic ICMS have demonstrated that, for simple stimulus quantities, like location or pressure, the animals can generalize instantaneously from natural to artificial feedback. However, the evoked sensations are almost certainly not naturalistic and it is not clear whether biomimetic strategies to elicit more complex sensations will be successful. The ability to adapt to novel

Plasticity

Somatosensory cortex has been shown to change adaptively when the pattern of afferentation changes. For example, when a digit is stimulated more than its neighbors, its cortical magnification increases (Elbert et al., 1995, Jenkins et al., 1990). Changes in cortical magnification are also observed in medical conditions when some body parts are overused, such as the writer's cramp and carpal tunnel (Nelson et al., 2009, Tecchio et al., 2002). Similarly, when a digit is severed, the cortical

Reliability and safety

For ICMS to be a viable approach for conveying somatosensory feedback, it must be both reliable and safe. Unfortunately, chronically implanted electrode arrays are not sufficiently robust to last in the brain for decades. Indeed, the electrodes degrade over time (Kane et al., 2013, Prasad et al., 2012) and electrode arrays are susceptible to outright failure, most often due to connector issues (Barrese et al., 2013, Simeral et al., 2011). Given the highly invasive surgery required for

Conclusions

The development of anthropomorphic robotic arms and of algorithms to decode motor intention based on signals from the brain has led to remarkable demonstrations of human patients controlling robotic arms by thought (Collinger et al., 2013, Hochberg et al., 2012). However, this technology will likely not transition into the clinic until somatosensory feedback is incorporated. Indeed, controlling an arm without somatosensation is challenging even with an intact motor system. While patients with

Acknowledgments

This work is supported by the Defense Advanced Research Projects Agency under contract N6601-10-C-4056, by the National Science Foundation grant DGE-0903637, by the National Institutes of Health grant RO1 NS08285, and by the Chicago Biological Consortium grant c-049.

References (85)

  • R.A. Sherman

    Stump and phantom limb pain

    Neurol. Clin.

    (1989)
  • G. Stuart

    Action potential initiation and backpropagation in neurons of the mammalian CNS

    Trends Neurosci.

    (1997)
  • E.J. Tehovnik

    Electrical stimulation of neural tissue to evoke behavioral responses

    J. Neurosci. Methods

    (1996)
  • T.D. Waberski

    Immediate cortical reorganization after local anesthetic block of the thumb: source localization of somatosensory evoked potentials in human subjects

    Neurosci. Lett.

    (2003)
  • T.W. Wright

    Prosthetic usage in major upper extremity amputations

    J. Hand. Surg. [Am.]

    (1995)
  • J.C. Barrese

    Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates

    J. Neural Eng.

    (2013)
  • S.J. Bensmaia et al.

    Tactile feedback from the hand

  • S.J. Bensmaia

    The representation of stimulus orientation in the early stages of somatosensory processing

    J. Neurosci.

    (2008)
  • J.A. Berg

    Behavioral demonstration of a somatosensory neuroprosthesis

    IEEE Trans. Neural Syst. Rehabil. Eng.

    (2013)
  • E. Biddiss

    Consumer design priorities for upper limb prosthetics

    Disabil. Rehabil. Assist. Technol.

    (2007)
  • N. Birbaumer

    Effects of regional anesthesia on phantom limb pain are mirrored in changes in cortical reorganization

    J. Neurosci.

    (1997)
  • A. Bjorkman

    Phantom digit somatotopy: a functional magnetic resonance imaging study in forearm amputees

    Eur. J. Neurosci.

    (2012)
  • M. Björnsdotter

    Somatotopic organization of gentle touch processing in the posterior insular cortex

    J. Neurosci.

    (2009)
  • D. Borsook

    Acute plasticity in the human somatosensory cortex following amputation

    Neuroreport

    (1998)
  • M. Botvinick et al.

    Rubber hands ‘feel’ touch that eyes see

    Nature

    (1998)
  • T. Brochier

    The effects of muscimol inactivation of small regions of motor and somatosensory cortex on independent finger movements and force control in the precision grip

    Exp. Brain Res.

    (1999)
  • K.H. Chen

    The effect of chronic intracortical microstimulation on the electrode–tissue interface

    J. Neural Eng.

    (2014)
  • M.C. Dadarlat

    Multisensory integration of vision and intracortical microstimulation for sensory substitution and augmentation

  • J. Daly

    Optimal space-time precoding of artificial sensory feedback through mutichannel microstimulation in bi-directional brain–machine interfaces

    J. Neural Eng.

    (2012)
  • K.D. Davis

    Phantom sensations generated by thalamic microstimulation

    Nature

    (1998)
  • H.R. Dinse

    Alterations in correlated activity parallel ICMS-induced representational plasticity

    Neuroreport

    (1993)
  • B.B. Edin

    Finger joint movement sensitivity of non-cutaneous mechanoreceptor afferents in the human radial nerve

    Exp. Brain Res.

    (1990)
  • B.B. Edin

    Quantitative analyses of dynamic strain sensitivity in human skin mechanoreceptors

    J. Neurophysiol.

    (2004)
  • T. Elbert

    Increased cortical representation of the fingers of the left hand in string players

    Science

    (1995)
  • H. Flor

    Phantom-limb pain as a perceptual correlate of cortical reorganization following arm amputation

    Nature

    (1995)
  • V. Gazzola

    Primary somatosensory cortex discriminates affective significance in social touch

    Proc. Natl. Acad. Sci.

    (2012)
  • B. Godde

    Plasticity of orientation preference maps in the visual cortex of adult cats

    Proc. Natl. Acad. Sci.

    (2002)
  • J. Gordon

    Impairments of reaching movements in patients without proprioception. I. Spatial errors

    J. Neurophysiol.

    (1995)
  • M.A. Harvey

    Multiplexing stimulus information through rate and temporal codes in primate somatosensory cortex

    PLoS Biol.

    (2013)
  • M.J. Hertenstein

    The communication of emotion via touch

    Emotion

    (2009)
  • L.R. Hochberg

    Reach and grasp by people with tetraplegia using a neurally controlled robotic arm

    Nature

    (2012)
  • W.M. Jenkins

    Functional reorganization of primary somatosensory cortex in adult owl monkeys after behaviorally controlled tactile stimulation

    J. Neurophysiol.

    (1990)
  • Cited by (51)

    • Continuity within the somatosensory cortical map facilitates learning

      2022, Cell Reports
      Citation Excerpt :

      Beyond a better understanding of sensory perception, our findings could be key to the efficient delivery of sensory information in the context of sensorimotor neuroprostheses (Chen et al., 2020; Dadarlat et al., 2015; Hartmann et al., 2016; O’Doherty et al., 2011). Recent active neuroprostheses tend to match as closely as possible the spatial and temporal aspects of physiological cortical responses to tactile and proprioceptive inputs (Flesher et al., 2021; Tabot et al., 2015), as well as to visual inputs (Dobelle, 2000; Fernández et al., 2021). However, most studies relied on discrete patterns of stimulation in space and time, whereas everyday prosthesis use is likely to generate complex, continuous sensory feedback.

    • Touch restoration through electrical cortical stimulation in humans

      2021, Somatosensory Feedback for Neuroprosthetics
    • Artificial sensory feedback for bionic hands

      2019, Intelligent Biomechatronics in Neurorehabilitation
    View all citing articles on Scopus
    View full text