image: Improving experimental design and statistical analyses alone will not solve the reproducibility crisis in science, argues Ray Dingledine in a societal impact article published in eNeuro. Repeating classic behavioral economics experiments with graduate- to senior-level researchers, the author finds scientists of all career stages are subject to the same biases as undergraduates when interpreting data. view more
Credit: Dingledine, <em>eNeuro</em> (2018)
Improving experimental design and statistical analyses alone will not solve the reproducibility crisis in science, argues Ray Dingledine in a societal impact article published in eNeuro. Repeating classic behavioral economics experiments with graduate- to senior-level researchers, the author finds scientists of all career stages are subject to the same biases as undergraduates when interpreting data.
In the 1960s and '70s, psychologists Daniel Kahneman and Amos Tversky demonstrated that people tend to engage in "fast thinking" -- relying on preconceived notions and emotions -- when making decisions in the face of new information. While this finding has had clear implications for economic decisions such as weighing the risks and rewards of a financial investment, Dingledine wondered whether it would also apply to scientific decision-making.
A survey of present-day graduate students, postdoctoral and senior research staff, and principal investigators across three basic science departments revealed that these scientists were just as likely as the university students tested by Kahneman and Tversky 45 years ago to jump to conclusions when grappling with unfamiliar data. Conducting a "premortem" before new experiments take place could help to identify these potential pitfalls and encourage scientists to think more like the forward-planning ancient Greek Titan Prometheus rather than his hasty brother Epimetheus.
###
Article: Why Is It So Hard To Do Good Science?
DOI: https://doi.org/10.1523/ENEURO.0188-18.2018
Corresponding author: Ray Dingledine (Emory University School of Medicine, Atlanta, GA, USA), rdingle@emory.edu
About eNeuro
eNeuro, the Society for Neuroscience's open-access journal launched in 2014, publishes rigorous neuroscience research with double-blind peer review that masks the identity of both the authors and reviewers, minimizing the potential for implicit biases. eNeuro is distinguished by a broader scope and balanced perspective achieved by publishing negative results, failure to replicate or replication studies. New research, computational neuroscience, theories and methods are also published.
About The Society for Neuroscience
The Society for Neuroscience is the world's largest organization of scientists and physicians devoted to understanding the brain and nervous system. The nonprofit organization, founded in 1969, now has nearly 37,000 members in more than 90 countries and over 130 chapters worldwide.
Journal
eNeuro