Abstract
Rationale
Evaluation of risks and rewards associated with different options is facilitated by components of the mesocorticolimbic dopamine (DA) system. Augmenting or reducing DA activity increases or decreases preference for larger, uncertain rewards when reward probabilities decrease within a session. However, manipulations of DA activity may differentially alter risky choice when shifts in the relative value of probabilistic rewards are greater or lesser than those experienced previously.
Objectives
We investigated the effects of amphetamine and the DA antagonist flupenthixol on risk discounting, whereby we altered the manner in which reward probabilities changed.
Methods
Rats chose between a “Small/Certain” (one pellet) and a “Large/Risky” lever that delivered four pellets in a probabilistic manner that changed during a session. Separate groups of rats were trained with a descending (100%, 50%, 25%, 12.5%), ascending (12.5–100%) or mixed (100%, 12.5%, 25%, 50%) order of probabilities associated with the large/risky option.
Results
Flupenthixol consistently decreased preference for the large/risky option. In contrast, amphetamine increased preference for the large/risky lever when the probabilities decreased over a session, but reduced preference in the ascending condition.
Conclusions
Reductions in normal DA tone consistently biases choice away larger, probabilistic rewards. In contrast, increases in DA release may disrupt adjustments in behavior in response to changes in the relative value of certain versus uncertain rewards. These findings further clarify the role of DA in mediating risk/reward judgments and how perturbations in DA signaling may interfere with the ability to adjust decision making in response to changes in reward contingencies.
Similar content being viewed by others
References
Bardgett ME, Depenbrock M, Downs N, Points M, Green L (2009) Dopamine modulates effort-based decision making in rats. Behav Neurosci 123:242–251
Cardinal RN, Howes NJ (2005) Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 6:9
Cardinal RN, Robbins TW, Everitt BJ (2000) The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioral manipulations on choice of signaled and unsignalled delayed reinforcement in rats. Psychopharmacology 152:362–375
Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW (2007) L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson’s disease. Neuropsychopharmacology 32:180–189
Denk F, Walton ME, Jennings KA, Sharp T, Rushworth MFS, Bannerman DM (2005) Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology 179:587–596
Evenden JL, Robbins TW (1985) The effects of d-amphetamine, chlordiazepoxide and alpha-flupenthixol on food-reinforced tracking of a visual stimulus by rats. Psychopharmacology 85:361–366
Evenden JL, Ryan CN (1996) The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128:161–170
Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898–1902
Floresco SB, Phillips AG (2001) Delay-dependent modulation of memory retrieval by infusion of a dopamine D1 agonist into the rat medial prefrontal cortex. Behav Neurosci 115:934–939
Floresco SB, Magyar O (2006) Mesocortical dopamine modulation of executive functions: beyond working memory. Psychopharmacology 188:567–585
Floresco SB, Whelan JM (2009) Perturbations in different forms of cost/benefit decision making induced by repeated amphetamine exposure. Psychopharmacology 205:189–201
Floresco SB, Tse MT, Ghods-Sharifi S (2008a) Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 33:1966–1979
Floresco SB, St. Onge JR, Ghods-Sharifi S, Winstanley CA (2008b) Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn Affect Behav Neurosci 8:375–389
Gan JO, Walton ME, Phillips PE (2010) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25–27
Genn RF, Ahn S, Phillips AG (2004) Attenuated dopamine efflux in the rat nucleus accumbens during successive negative contrast. Behav Neurosci 118:869–873
Ghods-Sharifi S, St. Onge JR, Floresco SB (2009) Fundamental contribution by the basolateral amygdala to different forms of decision making. J Neurosci 29:5251–5259
Hutton SB, Murphy FC, Joyce EM, Rogers RD, Cuthbert I, Barnes TR, McKenna PJ, Sahakian BJ, Robbins TW (2002) Decision making deficits in patients with first episode and chronic schizophrenia. Schizophr Res 55:249–257
Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191:507–520
Pagonabarraga J, García-Sánchez C, Llebaria G, Pascual-Sedano B, Gironell A, Kulisevsky J (2007) Controlled study of decision-making and cognitive impairment in Parkinson’s disease. J Mov Disord 22:1430–1435
Phillips AG, Vacca G, Ahn S (2008) A top-down perspective on dopamine, motivation and memory. Pharmacol Biochem Behav 90:236–249
Rogers RD, Everitt BJ, Baldacchino A, Blackshaw AJ, Swainson R, Wynne K, Baker NB, Hunter J, Carthy T, Booker E et al (1999) Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms. Neuropsychopharmacology 20:322–339
Roiser JP, McLean A, Ogilvie AD, Blackwell AD, Bamber DJ, Goodyer I, Jones PB, Sahakian BJ (2005) The subjective and cognitive effects of acute phenylalanine and tyrosine depletion in patients recovered from depression. Neuropsychopharmacology 30:775–785
Salamone JD, Cousins MS, Bucher S (1994) Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 65:221–229
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593–1599
Simon NW, Gilbert RJ, Mayse JD, Bizon JL, Setlow B (2009) Balancing risk and reward: a rat model of risky decision making. Neuropsychopharmacology 34:2208–2217
Slezak JM, Anderson KG (2009) Effects of variable training, signaled and unsignaled delays, and d-amphetamine on delay-discounting functions. Behav Pharmacol 20:424–436
St. Onge JR, Floresco SB (2009a) Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 34:681–697
St. Onge JR, Floresco SB (2009b) Prefrontal cortical contribution to risk-based decision making. Cereb Cortex, published online Nov 5, doi:10.1093/cercor/bhp250
van Gaalen MM, van Koten R, Schoffelmeer ANM, Vanderschuren LJMJ (2006) Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol Psychiatry 60:66–73
Weiner I (1990) Neural substrates of latent inhibition: the switching model. Psychol Bull 108:443–461
Weiner I, Feldon J (1985) Reversal and nonreversal shifts under amphetamine. Psychopharmacology 89:355–359
Zahrt J, Taylor JR, Mathew RG, Arnsten AF (1997) Supranormal stimulation of D1 dopamine receptors in the rodent prefrontal cortex impairs working memory performance. J Neurosci 17:8528–8535
Zeeb FD, Robbins TW, Winstanley CA (2009) Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34:2329–2343
Acknowledgments
This work was supported by a grant from the Canadian Institutes of Health Research (MOP 89861) to SBF. SBF is a Michael Smith Foundation for Health Research Senior Scholar and JRSO is the recipient of scholarships from the Natural Sciences and Engineering Research Council of Canada and the Michael Smith Foundation for Health Research. We are grateful to Gina Yuan Chun Chang and Titus Yip for their assistance with behavioral testing.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Supplemental Figure 1
The effects of amphetamine on risk discounting with ascending probabilities. Of the 16 rats used in this experiment, six showed a preference for the small/certain lever (i.e., away from the large/risky lever) in the first block (risk averse, left panel), and the remaining ten rats displayed a prominent bias towards this lever (risky, right panel). We analyzed the choice data from both groups separately. For the risk-averse rats, the analysis revealed a significant treatment × trial block interaction (F(3,15) = 3.26, P = 0.05), and simple main effects analysis confirmed that amphetamine significantly (P < 0.05, denoted by stars) reduced risky choice in the 25% and 50% probability blocks compared to saline. Similarly, analysis of the data from the risky subgroup revealed a significant main effect of treatment (F(1,9) = 6.22, P < 0.05), indicating that amphetamine reduced preference for the Large/Risky lever across all blocks (GIF 28 kb)
Rights and permissions
About this article
Cite this article
St. Onge, J.R., Chiu, Y.C. & Floresco, S.B. Differential effects of dopaminergic manipulations on risky choice. Psychopharmacology 211, 209–221 (2010). https://doi.org/10.1007/s00213-010-1883-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00213-010-1883-y