ReviewStatistical and Methodological Considerations for the Interpretation of Intranasal Oxytocin Studies
Section snippets
The Statistical Power Of Behavioral In-Ot Studies In Humans
Statistical power is the probability that a test will be able to reject the null hypothesis considering a true relation with a given effect size. True effect size values are, however, difficult, if not impossible, to acquire. This problem can to some extent be avoided by using effect size estimates from meta-analyses of relevant prior studies. Even though summary effects from meta-analyses can be inflated due to various sources of bias (8), these analyses provide the best estimates of the true
The Positive Predictive Value of Behavioral In-Ot Studies In Humans
The formula for calculating the PPV using information on power (1 − β), the prestudy odds (R; described below), and the alpha level (α) is PPV = [(1 − β) × R] / [(1 − β) × R + α].
Although rather exact values for both power (calculated above) and alpha level (most commonly set to 5%) can be put into this formula, picking a reasonable value for R is more problematic. Within any research field, both true and false hypotheses can be made. Thus, R represents the ratio of the number of true
Bias In Behavioral In-Ot Studies In Humans
When reading the literature on behavioral IN-OT studies in humans, it is obvious that most articles report positive findings, which is in line with a study by Fanelli (22) showing that more than 80% of scientific publications in various sciences report positive results. Considering the low statistical power within the field of IN-OT, we would expect that approximately 80% of all attempts to detect a true effect would fail. But it seems very unlikely that all hypotheses about how IN-OT affects
Conclusions and Recommendations
Our analyses demonstrate that IN-OT studies are generally considerably underpowered. This leads to a high probability that the reported effects of IN-OT are overestimated. Also, underpowered studies are prone to other types of biases, such as the use of questionable research practices. The combination of low power and low prestudy odds results in low PPV estimates. Taken together, this suggests that most of the reported positive findings regarding how OT affects human behavior are likely to be
Acknowledgments and Disclosures
Preparation of this manuscript was supported by National Institutes of Health Grants R01MH096983 and 1P50MH100023. Additional funding was provided by National Institutes of Health Office of the Director Grant No.P51OD11132 to Yerkes National Primate Research Center.
HW thanks the Swedish Brain Foundation for financial support.
LJY has applied for a patent (US20120108510 – Methods of improving behavioral therapies) for combining melanocortin agonists with behavioral therapies to enhance social
References (48)
- et al.
Social effects of oxytocin in humans: Context and person matter
Trends Cogn Sci
(2011) - et al.
Modulating social behavior with oxytocin: How does it work? What does it mean?
Horm Behav
(2012) - et al.
Intranasal oxytocin effects on social cognition: A critique
Brain Res
(2014) - et al.
Recommendations for the standardisation of oxytocin nasal administration and guidelines for its reporting in human research
Psychoneuroendocrinology
(2013) - et al.
Oxytocin and the neural mechanisms regulating social cognition and affiliative behavior
Front Neuroendocrin
(2009) - et al.
Editorial comment: Oxytocin, vasopressin and social behavior
Horm Behav
(2012) - et al.
Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects
J Clin Epidemiol
(2011) - et al.
A sniff of trust: Meta-analysis of the effects of intranasal oxytocin administration on face recognition, trust to in-group, and trust to out-group
Psychoneuroendocrinology
(2012) - et al.
Intranasal oxytocin: Myths and delusions
Biol Psychiatry
(2016) The file drawer problem and tolerance for null results
Psychol Bull
(1979)
Neuropeptides and the evolution of social behavior
Curr Opin Neurobiol
Five years of GWAS discovery
Am J Hum Genet
The oxytocin system in drug discovery for autism: Animal models and novel therapeutic strategies
Horm Behav
Neonatal melanocortin receptor agonist treatment reduces play fighting and promotes adult attachment in prairie voles in a sex-dependent manner
Neuropharmacology
The neuroanatomical distribution of oxytocin receptor binding and mRNA in the male rhesus macaque (Macaca mulatta)
Psychoneuroendocrinology
Neuroanatomical distribution of oxytocin and vasopressin 1a receptors in the socially monogamous coppery titi monkey (Callicebus cupreus)
Neuroscience
Localization of high-affinity binding sites for oxytocin and vasopressin in the human brain. An autoradiographic study
Brain Res
Oxytocin increases gaze to the eye region of human faces
Biol Psychiatry
Oxytocin, social cognition and psychiatry
Neuropsychopharmacology
The impact of a single administration of intranasal oxytocin on the recognition of basic emotions in humans: A meta-analysis
Neuropsychopharmacology
Sniffing around oxytocin: Review and meta-analyses of trials in healthy and clinical groups with implications for pharmacotherapy
Transl Psychiatry
G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences
Behav Res Methods
R: A Language and Environment for Statistical Computing
Power failure: Why small sample size undermines the reliability of neuroscience
Nat Rev Neurosci
Cited by (242)
Better safe than sorry: Oxytocin shifts the regulatory focus
2023, PsychoneuroendocrinologyApplying a drift diffusion model to test the effect of oxytocin on attentional biases in body dysmorphic disorder
2023, Journal of Obsessive-Compulsive and Related DisordersFour-week intranasal oxytocin administration reduces attachment avoidance in older women
2023, Hormones and BehaviorIntertwined associations between oxytocin, immune system and major depressive disorder
2023, Biomedicine and PharmacotherapyOxytocin has sex-specific effects on trust and underlying neurophysiological processes
2023, Psychoneuroendocrinology