Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Blog
    • Collections
    • Podcast
  • TOPICS
    • Cognition and Behavior
    • Development
    • Disorders of the Nervous System
    • History, Teaching and Public Awareness
    • Integrative Systems
    • Neuronal Excitability
    • Novel Tools and Methods
    • Sensory and Motor Systems
  • ALERTS
  • FOR AUTHORS
  • ABOUT
    • Overview
    • Editorial Board
    • For the Media
    • Privacy Policy
    • Contact Us
    • Feedback
  • SUBMIT

User menu

Search

  • Advanced search
eNeuro

eNeuro

Advanced Search

 

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Blog
    • Collections
    • Podcast
  • TOPICS
    • Cognition and Behavior
    • Development
    • Disorders of the Nervous System
    • History, Teaching and Public Awareness
    • Integrative Systems
    • Neuronal Excitability
    • Novel Tools and Methods
    • Sensory and Motor Systems
  • ALERTS
  • FOR AUTHORS
  • ABOUT
    • Overview
    • Editorial Board
    • For the Media
    • Privacy Policy
    • Contact Us
    • Feedback
  • SUBMIT
PreviousNext
Societal Impact, History, Teaching, and Public Awareness

Why Is It so Hard to Do Good Science?

Ray Dingledine
eNeuro 4 September 2018, 5 (5) ENEURO.0188-18.2018; DOI: https://doi.org/10.1523/ENEURO.0188-18.2018
Ray Dingledine
1Department of Pharmacology, Emory University School of Medicine, Atlanta, GA 30322
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ray Dingledine
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Figure 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1.

    Low sample size produces high variance. A, Map of the average kidney cancer incidence in each of the 3141 counties of the United States between 2010 and 2014. B, Plot of incidence as a function of county population. C, Five-year trend in incidence versus population. Data from the CDC National Program of Cancer Registries.

  • Figure 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2.

    Microarray clustering procedure drastically alters the visual pattern. The data were from dentate granule cells provided by seven laboratories and consist of median log2 expression values of 398 genes that were differentially expressed (FDR < 0.05) with ≥2-fold expression change between control rats and rats in three status epilepticus (SE) models at different times after SE (Dingledine et al., 2017). Complete linkage and row (gene)-clustering only; the relative positions of columns (treatment groups) in A, B are unvarying. The only difference in the two procedures was the distance measurement used. The Heatmapper tool was used for clustering and visualization (http://www1.heatmapper.ca/expression/).

  • Figure 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 3.

    Pockets of seeming regularity in a random process. The left panel shows the location of each of the bombs dropped on London during the eight-month blitzkrieg of 1940–1941. Although the city was blanket-bombed, there were isolated neighborhood-size areas in which no bombs fell as shown on the right panel (from http://www.dailymail.co.uk/sciencetech/article-2243951/The-astonishing-interactive-map-EVERY-bomb-dropped-London-Blitz.html).

  • Figure 4.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 4.

    Similarity of judgments in populations of undergraduates and scientists separated by 45 years.

  • Figure 5.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 5.

    Demonstration of the value of a Bayesian approach when interpreting a single experiment. A, Consider the scientist facing the challenge of testing 1000 hypotheses, for example, in a proteomics or drug screening experiment, in which each protein measured or compound assayed tests the hypothesis that the protein expression is changed or the compound is active. Without knowledge of the target class only a small fraction of these hypotheses (say 10%) are true. If the power of the experiment is 80%, 80 hypotheses will be correctly identified as true (marked “true +”) and 20 will be false negatives (“false –”) as shown in the expected outcomes table. Of the 900 remaining false hypotheses, 45 will be incorrectly ascribed as being true (“false +” in the table) with α = 0.05, and 855 will be correctly ascertained as negatives (“true –”). Thus, the chance of correctly interpreting a positive outcome (equivalent to precision in a ROC analysis) is only 64% (=80/125). B, If the statistical power of the experiment is 30%, the chance of correctly interpreting a positive result drops to only 40% (=45/75). Blue in the outcomes table represent numbers that have changed from the previous panel. C, Now imagine that, with experience, one is working in a more restricted target space in which 40% of hypotheses are expected to be true: the chance of correctly interpreting a positive result jumps to 80% even when power = 30% (=120/150). D, A plot of these variables (plus the 10% power case) shows that the chance of correctly interpreting a single outcome depends on α, power, and the a priori probability that the hypothesis is true.

Tables

  • Figures
    • View popup
    Table 1.

    Failure to take employment numbers into account when guessing professional field.

    2018RankMean scoreField2016 United States employment*
    12.7Computer science4,165,140
    23.0Engineering2,499,050
    33.5Physics or biology150,970
    44.4Library science222,760
    54.8Law1,075,520
    65.5Business administration14,371,980
    76.3Healthcare12,361,980
    87.0Humanities and education12,928,630
    97.9Social sciences and social work2,264,070
    • *Bureau of Labor Statistics.

Back to top

In this issue

eneuro: 5 (5)
eNeuro
Vol. 5, Issue 5
September/October 2018
  • Table of Contents
  • Index by author
Email

Thank you for sharing this eNeuro article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Why Is It so Hard to Do Good Science?
(Your Name) has forwarded a page to you from eNeuro
(Your Name) thought you would be interested in this article in eNeuro.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
Why Is It so Hard to Do Good Science?
Ray Dingledine
eNeuro 4 September 2018, 5 (5) ENEURO.0188-18.2018; DOI: 10.1523/ENEURO.0188-18.2018

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Share
Why Is It so Hard to Do Good Science?
Ray Dingledine
eNeuro 4 September 2018, 5 (5) ENEURO.0188-18.2018; DOI: 10.1523/ENEURO.0188-18.2018
Reddit logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Significance Statement
    • Introduction
    • Prologue
    • The Law of Small Numbers
    • Intuitive Pattern Seeking
    • Ignoring the Likelihood of a New Result
    • Conclusions and Recommendations
    • Acknowledgments
    • Footnotes
    • References
    • Synthesis
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Keywords

  • Bayesian
  • cognitive psychology
  • decision making
  • premortem
  • reproducibility
  • rigor

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

Societal Impact

  • Questionable Research Practices, Low Statistical Power, and Other Obstacles to Replicability: Why Preclinical Neuroscience Research Would Benefit from Registered Reports
  • Blood Analysis of Laboratory Macaca mulatta Used for Neuroscience Research: Investigation of Long-Term and Cumulative Effects of Implants, Fluid Control, and Laboratory Procedures
  • Factors That Influence Career Choice among Different Populations of Neuroscience Trainees
Show more Societal Impact

History, Teaching, and Public Awareness

  • Questionable Research Practices, Low Statistical Power, and Other Obstacles to Replicability: Why Preclinical Neuroscience Research Would Benefit from Registered Reports
  • Blood Analysis of Laboratory Macaca mulatta Used for Neuroscience Research: Investigation of Long-Term and Cumulative Effects of Implants, Fluid Control, and Laboratory Procedures
  • Factors That Influence Career Choice among Different Populations of Neuroscience Trainees
Show more History, Teaching, and Public Awareness

Subjects

  • History, Teaching, and Public Awareness
  • Societal Impact

  • Home
  • Alerts
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Latest Articles
  • Issue Archive
  • Blog
  • Browse by Topic

Information

  • For Authors
  • For the Media

About

  • About the Journal
  • Editorial Board
  • Privacy Policy
  • Contact
  • Feedback
(eNeuro logo)
(SfN logo)

Copyright © 2023 by the Society for Neuroscience.
eNeuro eISSN: 2373-2822

The ideas and opinions expressed in eNeuro do not necessarily reflect those of SfN or the eNeuro Editorial Board. Publication of an advertisement or other product mention in eNeuro should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in eNeuro.