Expectation modulates neural representations of valence throughout the human brain

Neuroimage. 2015 Jul 15:115:214-23. doi: 10.1016/j.neuroimage.2015.04.037. Epub 2015 Apr 30.

Abstract

The brain's sensitivity to unexpected gains or losses plays an important role in our ability to learn new behaviors (Rescorla and Wagner, 1972; Sutton and Barto, 1990). Recent work suggests that gains and losses are ubiquitously encoded throughout the human brain (Vickery et al., 2011), however, the extent to which reward expectation modulates these valence representations is not known. To address this question, we analyzed recordings from 4306 intracranially implanted electrodes in 39 neurosurgical patients as they performed a two-alternative probability learning task. Using high-frequency activity (HFA, 70-200 Hz) as an indicator of local firing rates, we found that expectation modulated reward-related neural activity in widespread brain regions, including regions that receive sparse inputs from midbrain dopaminergic neurons. The strength of unexpected gain signals predicted subjects' abilities to encode stimulus-reward associations. Thus, neural signals that are functionally related to learning are widely distributed throughout the human brain.

Keywords: ECoG; HFA; High frequency activity; Intracranial electroencephalography; Reinforcement learning; Reward; Valence; Value; iEEG.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Adult
  • Algorithms
  • Anticipation, Psychological / physiology*
  • Brain / anatomy & histology*
  • Brain / physiology*
  • Brain Mapping
  • Dopaminergic Neurons / physiology
  • Drug Resistant Epilepsy / surgery
  • Electrodes, Implanted
  • Electroencephalography
  • Emotions / physiology
  • Female
  • Humans
  • Learning / physiology
  • Male
  • Mesencephalon / physiology
  • Reinforcement, Psychology
  • Reward