Skip to main content
Log in

Differential effects of dopaminergic manipulations on risky choice

  • Original Investigation
  • Published:
Psychopharmacology Aims and scope Submit manuscript

Abstract

Rationale

Evaluation of risks and rewards associated with different options is facilitated by components of the mesocorticolimbic dopamine (DA) system. Augmenting or reducing DA activity increases or decreases preference for larger, uncertain rewards when reward probabilities decrease within a session. However, manipulations of DA activity may differentially alter risky choice when shifts in the relative value of probabilistic rewards are greater or lesser than those experienced previously.

Objectives

We investigated the effects of amphetamine and the DA antagonist flupenthixol on risk discounting, whereby we altered the manner in which reward probabilities changed.

Methods

Rats chose between a “Small/Certain” (one pellet) and a “Large/Risky” lever that delivered four pellets in a probabilistic manner that changed during a session. Separate groups of rats were trained with a descending (100%, 50%, 25%, 12.5%), ascending (12.5–100%) or mixed (100%, 12.5%, 25%, 50%) order of probabilities associated with the large/risky option.

Results

Flupenthixol consistently decreased preference for the large/risky option. In contrast, amphetamine increased preference for the large/risky lever when the probabilities decreased over a session, but reduced preference in the ascending condition.

Conclusions

Reductions in normal DA tone consistently biases choice away larger, probabilistic rewards. In contrast, increases in DA release may disrupt adjustments in behavior in response to changes in the relative value of certain versus uncertain rewards. These findings further clarify the role of DA in mediating risk/reward judgments and how perturbations in DA signaling may interfere with the ability to adjust decision making in response to changes in reward contingencies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Bardgett ME, Depenbrock M, Downs N, Points M, Green L (2009) Dopamine modulates effort-based decision making in rats. Behav Neurosci 123:242–251

    Article  CAS  PubMed  Google Scholar 

  • Cardinal RN, Howes NJ (2005) Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 6:9

    Article  PubMed  Google Scholar 

  • Cardinal RN, Robbins TW, Everitt BJ (2000) The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioral manipulations on choice of signaled and unsignalled delayed reinforcement in rats. Psychopharmacology 152:362–375

    Article  CAS  PubMed  Google Scholar 

  • Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW (2007) L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson’s disease. Neuropsychopharmacology 32:180–189

    Article  CAS  PubMed  Google Scholar 

  • Denk F, Walton ME, Jennings KA, Sharp T, Rushworth MFS, Bannerman DM (2005) Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology 179:587–596

    Article  CAS  PubMed  Google Scholar 

  • Evenden JL, Robbins TW (1985) The effects of d-amphetamine, chlordiazepoxide and alpha-flupenthixol on food-reinforced tracking of a visual stimulus by rats. Psychopharmacology 85:361–366

    Article  CAS  PubMed  Google Scholar 

  • Evenden JL, Ryan CN (1996) The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128:161–170

    Article  CAS  PubMed  Google Scholar 

  • Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898–1902

    Article  CAS  PubMed  Google Scholar 

  • Floresco SB, Phillips AG (2001) Delay-dependent modulation of memory retrieval by infusion of a dopamine D1 agonist into the rat medial prefrontal cortex. Behav Neurosci 115:934–939

    Article  CAS  PubMed  Google Scholar 

  • Floresco SB, Magyar O (2006) Mesocortical dopamine modulation of executive functions: beyond working memory. Psychopharmacology 188:567–585

    Article  CAS  PubMed  Google Scholar 

  • Floresco SB, Whelan JM (2009) Perturbations in different forms of cost/benefit decision making induced by repeated amphetamine exposure. Psychopharmacology 205:189–201

    Article  CAS  PubMed  Google Scholar 

  • Floresco SB, Tse MT, Ghods-Sharifi S (2008a) Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 33:1966–1979

    Article  CAS  PubMed  Google Scholar 

  • Floresco SB, St. Onge JR, Ghods-Sharifi S, Winstanley CA (2008b) Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn Affect Behav Neurosci 8:375–389

    Article  PubMed  Google Scholar 

  • Gan JO, Walton ME, Phillips PE (2010) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25–27

    Article  CAS  PubMed  Google Scholar 

  • Genn RF, Ahn S, Phillips AG (2004) Attenuated dopamine efflux in the rat nucleus accumbens during successive negative contrast. Behav Neurosci 118:869–873

    Article  CAS  PubMed  Google Scholar 

  • Ghods-Sharifi S, St. Onge JR, Floresco SB (2009) Fundamental contribution by the basolateral amygdala to different forms of decision making. J Neurosci 29:5251–5259

    Article  CAS  PubMed  Google Scholar 

  • Hutton SB, Murphy FC, Joyce EM, Rogers RD, Cuthbert I, Barnes TR, McKenna PJ, Sahakian BJ, Robbins TW (2002) Decision making deficits in patients with first episode and chronic schizophrenia. Schizophr Res 55:249–257

    Article  CAS  PubMed  Google Scholar 

  • Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191:507–520

    Article  CAS  Google Scholar 

  • Pagonabarraga J, García-Sánchez C, Llebaria G, Pascual-Sedano B, Gironell A, Kulisevsky J (2007) Controlled study of decision-making and cognitive impairment in Parkinson’s disease. J Mov Disord 22:1430–1435

    Article  Google Scholar 

  • Phillips AG, Vacca G, Ahn S (2008) A top-down perspective on dopamine, motivation and memory. Pharmacol Biochem Behav 90:236–249

    Article  CAS  PubMed  Google Scholar 

  • Rogers RD, Everitt BJ, Baldacchino A, Blackshaw AJ, Swainson R, Wynne K, Baker NB, Hunter J, Carthy T, Booker E et al (1999) Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms. Neuropsychopharmacology 20:322–339

    Article  CAS  PubMed  Google Scholar 

  • Roiser JP, McLean A, Ogilvie AD, Blackwell AD, Bamber DJ, Goodyer I, Jones PB, Sahakian BJ (2005) The subjective and cognitive effects of acute phenylalanine and tyrosine depletion in patients recovered from depression. Neuropsychopharmacology 30:775–785

    CAS  PubMed  Google Scholar 

  • Salamone JD, Cousins MS, Bucher S (1994) Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 65:221–229

    Article  CAS  PubMed  Google Scholar 

  • Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593–1599

    Article  CAS  PubMed  Google Scholar 

  • Simon NW, Gilbert RJ, Mayse JD, Bizon JL, Setlow B (2009) Balancing risk and reward: a rat model of risky decision making. Neuropsychopharmacology 34:2208–2217

    Article  PubMed  Google Scholar 

  • Slezak JM, Anderson KG (2009) Effects of variable training, signaled and unsignaled delays, and d-amphetamine on delay-discounting functions. Behav Pharmacol 20:424–436

    Article  CAS  PubMed  Google Scholar 

  • St. Onge JR, Floresco SB (2009a) Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 34:681–697

    Article  CAS  Google Scholar 

  • St. Onge JR, Floresco SB (2009b) Prefrontal cortical contribution to risk-based decision making. Cereb Cortex, published online Nov 5, doi:10.1093/cercor/bhp250

  • van Gaalen MM, van Koten R, Schoffelmeer ANM, Vanderschuren LJMJ (2006) Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol Psychiatry 60:66–73

    Article  PubMed  Google Scholar 

  • Weiner I (1990) Neural substrates of latent inhibition: the switching model. Psychol Bull 108:443–461

    Article  Google Scholar 

  • Weiner I, Feldon J (1985) Reversal and nonreversal shifts under amphetamine. Psychopharmacology 89:355–359

    Google Scholar 

  • Zahrt J, Taylor JR, Mathew RG, Arnsten AF (1997) Supranormal stimulation of D1 dopamine receptors in the rodent prefrontal cortex impairs working memory performance. J Neurosci 17:8528–8535

    CAS  PubMed  Google Scholar 

  • Zeeb FD, Robbins TW, Winstanley CA (2009) Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34:2329–2343

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported by a grant from the Canadian Institutes of Health Research (MOP 89861) to SBF. SBF is a Michael Smith Foundation for Health Research Senior Scholar and JRSO is the recipient of scholarships from the Natural Sciences and Engineering Research Council of Canada and the Michael Smith Foundation for Health Research. We are grateful to Gina Yuan Chun Chang and Titus Yip for their assistance with behavioral testing.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stan B. Floresco.

Electronic supplementary material

Supplemental Figure 1

The effects of amphetamine on risk discounting with ascending probabilities. Of the 16 rats used in this experiment, six showed a preference for the small/certain lever (i.e., away from the large/risky lever) in the first block (risk averse, left panel), and the remaining ten rats displayed a prominent bias towards this lever (risky, right panel). We analyzed the choice data from both groups separately. For the risk-averse rats, the analysis revealed a significant treatment × trial block interaction (F(3,15) = 3.26, P = 0.05), and simple main effects analysis confirmed that amphetamine significantly (P < 0.05, denoted by stars) reduced risky choice in the 25% and 50% probability blocks compared to saline. Similarly, analysis of the data from the risky subgroup revealed a significant main effect of treatment (F(1,9) = 6.22, P < 0.05), indicating that amphetamine reduced preference for the Large/Risky lever across all blocks (GIF 28 kb)

High resolution image (TIFF 904 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

St. Onge, J.R., Chiu, Y.C. & Floresco, S.B. Differential effects of dopaminergic manipulations on risky choice. Psychopharmacology 211, 209–221 (2010). https://doi.org/10.1007/s00213-010-1883-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00213-010-1883-y

Keywords

Navigation