How do you (estimate you will) like them apples? Integration as a defining trait of orbitofrontal function
Introduction
In the past 15 years, we have seen a rapid and exponential increase in our understanding of orbitofrontal function. Today this region is the focus of an enormous amount of research, including work on such complex phenomena as regret, ambiguity, and willingness to pay [1•, 2•, 3•]. The orbitofrontal cortex is also credited as a major player in a host of neuropsychiatric diseases, including diverse disorders such as addiction, obsessive–compulsive disorder, mania and depression, and even schizophrenia [4•, 5, 6, 7, 8]. Here we will argue that this transformation began with the application of concepts derived from animal learning theory. We will review data from studies emphasizing these approaches to argue that the orbitofrontal cortex forms a crucial part of a network of structures that signals information about expected outcomes. Further we will suggest that, within this network, the orbitofrontal cortex provides the critical ability to integrate information in real-time to make what amounts to actionable predictions or estimates about future outcomes. As we will show, the influence of these estimates can be demonstrated experimentally in appropriate behavioral settings, and their operation can also readily explain the role of orbitofrontal cortex in much more complex phenomena such as those cited above. Additionally we will lay out a number of areas where critical questions remain to be answered.
Section snippets
Orbitofrontal cortex signals information about specific outcomes
An overarching principle of learning theory is that even very simple learning situations involve the acquisition of multiple parallel associative representations [9•]. In other words, when an animal is presented with a simple predictive relationship between a cue (e.g. light) and an outcome (e.g. food), the animal does not learn a simple unitary association. Rather the animal actually learns to represent different features of the relationship. While it is unclear how finely the unitary
Orbitofrontal cortex signals estimates about future outcomes
Yet even as associative significance was a poor descriptor of the function of the orbitofrontal cortex 20 years ago, the idea that the orbitofrontal cortex is crucial for signaling information about specific outcomes also seems scarcely sufficient for describing the complex role this area plays in behavior. For one, the orbitofrontal cortex is only one of a number of areas that is crucial to outcome-guided behaviors revealed by devaluation tasks [30, 31•, 32, 33, 34]. Moreover some of the more
Conclusions
Here we have reviewed evidence regarding the role of orbitofrontal cortex in associative learning, focusing on studies that have employed concepts from learning theory to specify more precisely the function mediated by this area. On the basis of this work, we have suggested that the orbitofrontal cortex is crucial for signaling information about the specific outcomes that can be expected in a particular situation. This function seems particularly necessary (i.e. not redundant with that provided
References and recommended reading
Papers of particular interest, published within the period of review, have been highlighted as:
• of special interest
•• of outstanding interest
Acknowledgements
This work was supported by grants to Dr Schoenbaum from the NIDA (R01-DA015718), NIMH (R01-MH080865), and NIA (R01-AG027097). In addition, Dr Esber was supported on an NIMH grant to Dr Peter Holland (R01-MH053667). The authors have no competing interests.
References (56)
- et al.
Separate neural mechanisms underlie choices and strategic preferences in risky decision making
Neuron
(2009) Functional anatomical abnormalities in limbic and prefrontal cortical structures in major depression
Progress in Brain Research
(2000)Acquisition of representation-mediated conditioned food aversions
Learning and Motivation
(1981)- et al.
Limbic lesions and the problem of stimulus-reinforcement associations
Experimental Neurology
(1972) - et al.
Neural economics and the biological substrates of valuation
Neuron
(2002) - et al.
The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes
Neuron
(2009) - et al.
Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation
Neuron
(2006) - et al.
Lesions to the basolateral amygdala and the orbitofrontal cortex but not to the medial prefrontal cortex produce an abnormally persistent latent inhibition in rats
Neuroscience
(2004) - et al.
Dissociation of decision-making under ambiguity and decision-making under risk in patients with Parkinson's disease: a neuropsychological and psychophysiological study
Neuropsychologia
(2009) - et al.
The involvement of the orbitofrontal cortex in the experience of regret
Science
(2004)
Orbitofrontal cortex encodes willingness to pay in everyday economic transactions
Journal of Neuroscience
The role of orbitofrontal cortex in drug addiction: a review of preclinical studies
Biological Psychiatry
Reduced dorsal and orbital prefrontal gray matter volumes in schizophrenia
Archives of General Psychiatry
Dissociation of decisions in ambiguous and risky situations in obsessive–compulsive disorder
Psychiatry Research
Understanding obsessive–compulsive disorder: focus on decision making
Neuropsychology Review
Pavlovian conditioning: it's not what you think it is
American Psychology
Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning
Journal of Experimental Psychology: Animal Behavior Processes
The effects of two ways of devaluing the unconditioned stimulus after first and second-order appetitive conditioning
Journal of Experimental Psychology: Animal Behavior Processes
Relations between Pavlovian–Instrumental transfer and reinforcer devaluation
Journal of Experimental Psychology: Animal Behavior Processes
Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus
Quarterly Journal of Experimental Psychology
Transfer of instrumental control mediated by a devalued outcome
Animal Learning and Behavior
The orbitofrontal cortex: neuronal activity in the behaving monkey
Experimental Brain Research
Orbitofrontal cortex and representation of incentive value in associative learning
Journal of Neuroscience
Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task
Journal of Neuroscience
Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency
Journal of Neuroscience
The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates
European Journal of Neuroscience
Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex
Journal of Neurophysiology
Encoding predictive reward value in human amygdala and orbitofrontal cortex
Science
Cited by (58)
Resting state functional magnetic resonance imaging study in mentally ill persons with diminished penal responsibility considered socially dangerous
2021, Psychiatry Research - NeuroimagingCitation Excerpt :It has been associated with the representation of reward and punishment and subserves aspects of moral behavior (Greene and Haidt, 2002) such as guilt, regret, and empathy (Camille et al., 2004; Pascual et al., 2013; Völlm et al., 2006). Here, we found that the FOrb was more connected with basal ganglia in the EG, suggesting that this node is crucial for signaling information when it has to be integrated to predict future outcomes or anticipate reward through instrumental and self-focused behavior (Schoenbaum and Esber, 2010). Finally, we found higher connectivity within the basal ganglia, between the left pallidum/left Amy, and between the ACC/caudate bilaterally in the EG.
Touch-screen visual reversal learning is mediated by value encoding and signal propagation in the orbitofrontal cortex
2017, Neurobiology of Learning and MemorySpontaneous regional brain activity links restrained eating to later weight gain among young women
2015, Biological PsychologyCitation Excerpt :Previous task-based fMRI studies found REs show comparatively more reward expectation region responsiveness to visual food cues and food receipt (e.g., Burger & Stice, 2011; Coletta et al., 2009). In concert with recent RS-fMRI findings (Dong et al., 2014), the current results bolstered evidence linking elevations in RE following food deprivation to increased spontaneous activity in regions associated with expectation and valuation for food reward values (Hare, Camerer, & Rangel, 2009; Hare, Malmaud, & Rangel, 2011; Rolls & Grabenhorst, 2008; Rushworth, Behrens, Rudebeck, & Walton, 2007; Schoenbaum & Esber, 2010; Zald & Andreotti, 2010) and attention (i.e., VMPFC, middle temporal gyrus, cuneus) in the absence of external food cues. Negative relations between RE and ReHo activity in specific inhibitory control areas (i.e., the bilateral DLPFC), were consistent with contentions that executive control centers have a pivotal role in ‘top-down’ processing (Gazzaley & D’Esposito, 2007; Miller & Cohen, 2001) and the central regulation of eating behavior (DelParigi et al., 2002; DelParigi, Pannacciulli, Le, & Tataranni, 2005; DelParigi et al., 2007).