Skip to main content
SpringerLink
Log in

A critical examination of best dose analysis for determining cognitive-enhancing potential of drugs: studies with rhesus monkeys and computer simulations

  • Original Investigation
  • Published:
Psychopharmacology Aims and scope Submit manuscript

Abstract

Rationale

Best dose analysis involves identifying the dose associated with the greatest improvement in performance for each subject and comparing performances associated with these individually determined best doses to control performances.

Objectives

The current experiments were conducted to examine whether significant best dose effects might result from the selective analysis of data rather than an actual drug effect.

Methods

Experiment 1 examined the effects of nicotine and methylphenidate on delayed matching-to-sample (DMTS) and self-ordered spatial search (SOSS) performances in rhesus monkeys (DMTS: n = 7; SOSS: n = 6) to determine the validity and reliability of best dose effects. Experiment 2 used Monte Carlo computer simulations to estimate the likelihood of obtaining a significant outcome when the best dose method was applied to randomly generated data sets for which no difference existed.

Results

Significant effects were obtained when the best dose analysis was applied to performances from nondrug sessions, and best dose performances were not significantly different from the best nondrug performances. The doses identified as best doses from two nicotine dose–response curve determinations were unrelated, and the improvement associated with the best dose observed during the first dose–response curve determination was not reliable when the dose was administered repeatedly. Finally, there was a high likelihood of obtaining a statistically significant difference when no real difference existed.

Conclusions

Best dose analysis for the identification of potential therapeutic agents should be replaced by single-subject designs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Arnsten AF, Contant TA (1992) Alpha-2 adrenergic agonists decrease distractibility in aged monkeys performing the delayed response task. Psychopharmacology (Berl) 108:159–169

    Article  CAS  Google Scholar 

  • Arnsten AF, Goldman-Rakic PS (1990) Analysis of alpha-2 adrenergic agonist effects on the delayed nonmatch-to-sample performance of aged rhesus monkeys. Neurobiol Aging 11:583–590

    Article  PubMed  CAS  Google Scholar 

  • Bain JN, Prendergast MA, Terry AV Jr, Arneric SP, Smith MA, Buccafusco JJ (2003) Enhanced attention in rhesus monkeys as a common factor for the cognitive effects of drugs with abuse potential. Psychopharmacology (Berl) 169:150–160

    Article  CAS  Google Scholar 

  • Bontempi B, Whelan KT, Risbrough VB, Rao TS, Buccafusco JJ, Lloyd GK, Menzaghi F (2001) SIB-1553A, (+/−)-4-[[2-(1-methyl-2-pyrrolidinyl)ethyl]thio]phenol hydrochloride, a subtype-selective ligand for nicotinic acetylcholine receptors with putative cognitive-enhancing properties: effects on working and reference memory performances in aged rodents and nonhuman primates. J Pharmacol Exp Ther 299:297–306

    PubMed  CAS  Google Scholar 

  • Brady JV (1956) Assessment of drug effects on emotional behavior. Science 123:1033–1034

    Article  PubMed  CAS  Google Scholar 

  • Branch MN (1999) Statistical inference in behavior analysis: some things significance testing does and does not do. Behav Anal 22:87–92

    PubMed  CAS  Google Scholar 

  • Branch MN, Pennypacker HS (2013) Generality and generalization of research findings. In: Madden GL, Dube WV, Hackenberg TD, Hanley GP, Lattal KA (eds) APA handbook of behavior analysis. American Psychological Association, Washington, DC, pp 151–175

  • Buccafusco JJ, Jackson WJ (1991) Beneficial effects of nicotine administered prior to a delayed matching-to-sample task in young and aged monkeys. Neurobiol Aging 12:233–238

    Article  PubMed  CAS  Google Scholar 

  • Buccafusco JJ, Terry AV Jr (2000) Multiple central nervous system targets for eliciting beneficial effects on memory and cognition. J Pharmacol Exp Ther 295:438–446

    PubMed  CAS  Google Scholar 

  • Buccafusco JJ, Terry AV (2004) Donepezil-induced improvement in delayed matching accuracy by young and old rhesus monkeys. J Mol Neurosci 24:85–91

    Article  PubMed  CAS  Google Scholar 

  • Buccafusco JJ, Jackson WJ, Terry AV Jr, Marsh KC, Decker MW, Arneric SP (1995) Improvement in performance of a delayed matching-to-sample task by monkeys following ABT-418: a novel cholinergic channel activator for memory enhancement. Psychopharmacology (Berl) 120:256–266

    Article  CAS  Google Scholar 

  • Buccafusco JJ, Prendergast MA, Terry AV, Jackson WJ (1996) Cognitive effects of nicotinic cholinergic receptor agonists in nonhuman primates. Drug Dev Res 38:196–203

    Article  CAS  Google Scholar 

  • Buccafusco JJ, Jackson WJ, Jonnala RR, Terry AV Jr (1999) Differential improvement in memory-related task performance with nicotine by aged male and female rhesus monkeys. Behav Pharmacol 10:681–690

    Article  PubMed  CAS  Google Scholar 

  • Buccafusco JJ, Jackson WJ, Stone JD, Terry AV (2003) Sex dimorphisms in the cognitive-enhancing action of the Alzheimer’s drug donepezil in aged rhesus monkeys. Neuropharmacology 44:381–389

    Article  PubMed  CAS  Google Scholar 

  • Buccafusco JJ, Letchworth SR, Bencherif M, Lippiello PM (2005) Long-lasting cognitive improvement with nicotinic receptor agonists: mechanisms of pharmacokinetic–pharmacodynamic discordance. Trends Pharmacol Sci 26:352–360

    Article  PubMed  CAS  Google Scholar 

  • Carver RP (1978) The case against statistical significance testing. Harv Educ Rev 48:378–399

    Google Scholar 

  • Carver RP (1993) The case against statistical significance testing, revisited. J Exp Educ 61:287–292

    Google Scholar 

  • Collett BJ (1988) Opioid tolerance: the clinical perspective. Br J Anaesth 81:58–68

    Article  Google Scholar 

  • Dallery J, Cassidy RN, Raiff BR (2013) Single-case experimental designs to evaluate novel technology-based health interventions. J Med Internet Res 15:e22

    Article  PubMed  Google Scholar 

  • Dews PB (1955a) Studies on behavior. I. Differential sensitivity to pentobarbital of pecking performance in pigeons depending on the schedule of reward. J Pharmacol Exp Ther 113:393–401

    PubMed  CAS  Google Scholar 

  • Dews PB (1955b) Studies on behavior. II. The effects of pentobarbital, methamphetamine and scopolamine on performances in pigeons involving discriminations. J Pharmacol Exp Ther 115:380–389

    PubMed  CAS  Google Scholar 

  • Elrod K, Buccafusco JJ, Jackson WJ (1988) Nicotine enhances delayed matching-to-sample performance by primates. Life Sci 43:277–287

    Article  PubMed  CAS  Google Scholar 

  • Falk R, Greenbaum CW (1995) Significance tests die hard: the amazing persistence of a probabilistic misconception. Theory & Psychology 5:75–98

    Article  Google Scholar 

  • Franowicz JS, Arnsten AF (1998) The alpha-2a noradrenergic agonist, guanfacine, improves delayed response performance in young adult rhesus monkeys. Psychopharmacology (Berl) 136:8–14

    Article  CAS  Google Scholar 

  • Gamo NJ, Wang M, Arnsten AF (2010) Methylphenidate and atomoxetine enhance prefrontal function through alpha2-adrenergic and dopamine D1 receptors. J Am Acad Child Adolesc Psychiatry 49:1011–1023

    Article  PubMed  Google Scholar 

  • Geerts H (2009) Of mice and men: bridging the translational disconnect in CNS drug discovery. CNS Drugs 23:915–926

    Article  PubMed  CAS  Google Scholar 

  • Gould RW, Garg PK, Garg S, Nader MA (2013) Effects of nicotinic acetylcholine receptor agonists on cognition in rhesus monkeys with a chronic cocaine self-administration history. Neuropharmacology 64:479–488

    Article  PubMed  CAS  Google Scholar 

  • Hackam DG (2007) Translating animal research into clinical benefit. BMJ 334:163–164

    Article  PubMed  Google Scholar 

  • Hackam DG, Redelmeier DA (2006) Translation of research evidence from animals to humans. JAMA 296:1731–1732

    Article  PubMed  CAS  Google Scholar 

  • Kaiyala KJ, Leroux BG, Watson CH, Prall CW, Coldwell SE, Woods SC, Ramsay DS (2001) Reliability of individual differences in initial sensitivity and acute tolerance to nitrous oxide hypothermia. Pharmacol Biochem Behav 68:691–699

    Article  PubMed  CAS  Google Scholar 

  • Kalant H, LeBlanc AE, Gibbins RJ (1971) Tolerance to, and dependence on, some non-opiate psychotropic drugs. Pharmacol Rev 23:135–191

    PubMed  CAS  Google Scholar 

  • Kangas BD, Branch MN (2012) Relations among acute and chronic nicotine administration, short-term memory, and tactics of data analysis. J Exp Anal Behav 98:155–167

    Article  PubMed  Google Scholar 

  • Katner SN, Davis SA, Kirsten AJ, Taffe MA (2004) Effects of nicotine and mecamylamine on cognition in rhesus monkeys. Psychopharmacology (Berl) 175:225–240

    Article  CAS  Google Scholar 

  • Kazdin AE (2011) Single-case research designs: methods for clinical and applied settings, 2nd edn. Oxford University Press, New York

    Google Scholar 

  • Kola I, Landis J (2004) Can the pharmaceutical industry reduce attrition rates? Nat Rev Drug Discov 3:711–715

    Article  PubMed  CAS  Google Scholar 

  • Madsen LG, Bytzer P (2002) Review article: single subject trials as a research instrument in gastrointestinal pharmacology. Aliment Pharmacol Ther 16:189–196

    Article  PubMed  CAS  Google Scholar 

  • McDonald JH (2009) Handbook of biological statistics, 2nd edn. Sparky House, Baltimore

    Google Scholar 

  • Morgan DL, Morgan RK (2001) Single-participant research design. Bringing science to managed care. Am Psychol 56:119–127

    Article  PubMed  CAS  Google Scholar 

  • Perel P, Roberts I, Sena E, Wheble P, Briscoe C, Sandercock P, Macleod M, Mignini LE, Jayaram P, Khan KS (2007) Comparison of treatment effects between animal experiments and clinical trials: systematic review. BMJ 334:197

    Article  PubMed  CAS  Google Scholar 

  • Perkins KA, Lerman C, Coddington SB, Jetton C, Karelitz JL, Scott JA, Wilson AS (2008) Initial nicotine sensitivity in humans as a function of impulsivity. Psychopharmacology (Berl) 200:529–544

    Article  CAS  Google Scholar 

  • Prendergast MA, Terry AV Jr, Jackson WJ, Marsh KC, Decker MW, Arneric SP, Buccafusco JJ (1997) Improvement in accuracy of delayed recall in aged and non-aged, mature monkeys after intramuscular or transdermal administration of the CNS nicotinic receptor agonist ABT-418. Psychopharmacology (Berl) 130:276–284

    Article  CAS  Google Scholar 

  • Prendergast MA, Jackson WJ, Terry AV Jr, Decker MW, Arneric SP, Buccafusco JJ (1998) Central nicotinic receptor agonists ABT-418, ABT-089, and (−)-nicotine reduce distractibility in adult monkeys. Psychopharmacology (Berl) 136:50–58

    Article  CAS  Google Scholar 

  • Sidman M (1960) Tactics of scientific research: evaluating experimental data in psychology. Basic Books, New York

    Google Scholar 

  • Smolen A, Marks MJ, DeFries JC, Henderson ND (1994) Individual differences in sensitivity to nicotine in mice: response to six generations of selective breeding. Pharmacol Biochem Behav 49:531–540

    Article  PubMed  CAS  Google Scholar 

  • Sohn D (1998) Statistical significance and replicability: why the former does not presage the latter. Theory & Psychology 8:291–311

    Article  Google Scholar 

  • Terry AV Jr, Buccafusco JJ, Jackson WJ (1993) Scopolamine reversal of nicotine enhanced delayed matching-to-sample performance in monkeys. Pharmacol Biochem Behav 45:925–929

    Article  PubMed  CAS  Google Scholar 

  • Terry AV Jr, Buccafusco JJ, Jackson WJ, Prendergast MA, Fontana DJ, Wong EH, Bonhaus DW, Weller P, Eglen RM (1998) Enhanced delayed matching performance in younger and older macaques administered the 5-HT4 receptor agonist, RS 17017. Psychopharmacology (Berl) 135:407–415

    Article  CAS  Google Scholar 

  • Terry AV Jr, Buccafusco JJ, Bartoszyk GD (2005) Selective serotonin 5-HT2A receptor antagonist EMD 281014 improves delayed matching performance in young and aged rhesus monkeys. Psychopharmacology (Berl) 179:725–732

    Article  CAS  Google Scholar 

  • Weed MR, Bryant R, Perry S (2008) Cognitive development in macaques: attentional set-shifting in juvenile and adult rhesus monkeys. Neuroscience 157:22–28

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgments

We would like to thank Stacey Perry, Raymond Smith, and Virginia Bogdan for their expert technical assistance in conducting these studies. We thank Michael R. Weed for the helpful discussions of the ideas set forth in this manuscript. This work was supported by NIA grant AG027798.

Conflicts of interest

We have no conflicts of interest to declare.

Author information

Authors and Affiliations

  1. Division of Behavioral Biology, Department of Psychiatry and Behavioral Sciences, Johns Hopkins School of Medicine, Baltimore, MD, USA

    Paul L. Soto, Nancy A. Ator & Brian R. Katz

  2. Department of Psychology, University of Florida, Gainesville, FL, USA

    Jesse Dallery

  3. Johns Hopkins School of Medicine, 5510 Nathan Shock Drive, Suite 3000, Baltimore, MD, 21224-6823, USA

    Paul L. Soto

Authors
  1. Paul L. Soto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jesse Dallery
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nancy A. Ator
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Brian R. Katz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul L. Soto.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Soto, P.L., Dallery, J., Ator, N.A. et al. A critical examination of best dose analysis for determining cognitive-enhancing potential of drugs: studies with rhesus monkeys and computer simulations. Psychopharmacology 228, 611–622 (2013). https://doi.org/10.1007/s00213-013-3070-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00213-013-3070-4

Keywords

Search

Navigation