Failing the Future: Three Unsuccessful Attempts to Replicate Bem's 'Retroactive Facilitation of Recall' Effect
⚡ Contested ↗📌 Appears in:
Plain English Summary
Remember Daryl Bem's headline-grabbing 2011 claim that people could sense the future? This study put one of his flashiest experiments to the test, and the results were a resounding thud. Three independent university teams (Edinburgh, Goldsmiths, and Hertfordshire) each ran Bem's "retroactive recall" experiment with 50 participants, using his own software and methods. Combined, they had a massive 99.92% statistical power to detect his claimed effect. The result? Absolutely nothing. No hint of precognition in any of the three attempts. Notably, the researchers pre-registered their studies (publicly committing to their methods in advance) and used blind raters, setting a gold standard for how replications should be done. Their verdict: Bem's original positive finding was likely due to experimental artifacts rather than psychic ability. This became a landmark data point in the ongoing debate over Bem's controversial research.
Abstract
Nine recently reported parapsychological experiments appear to support the existence of precognition. We describe three pre-registered independent attempts to exactly replicate one of these experiments, 'retroactive facilitation of recall', which examines whether performance on a memory test can be influenced by a post-test exercise. All three replication attempts failed to produce significant effects (combined n = 150; combined p = .83, one-tailed) and thus do not support the existence of psychic ability.
Links
Related Papers
Replication Of
Cites
- Why Psychologists Must Change the Way They Analyze Their Data: The Case of Psi — Wagenmakers, Eric-Jan. (2011)
- A Bayes Factor Meta-Analysis of Bem's ESP Claim — Rouder, Jeffrey N. (2011)
- Back from the Future: Parapsychology and the Bem Affair — Alcock, James E. (2011)
- Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice — LeBel, Etienne P. (2011)
- Why Is Psi So Elusive? A Review and Proposed Model — Kennedy, James E. (2001)
Companion
- Retro-priming, priming, and double testing: psi and replication in a test–retest design — Rabeyron, Thomas. (2014)
- Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence? — Pashler, Harold. (2012)
- False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant — Simmons, Joseph P. (2011)
- We Should Have Seen This Coming — Schwarzkopf, D. Samuel. (2014)
- Correcting the Past: Failures to Replicate Psi — Galak, Jeff. (2012)
- Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli? — Wagenmakers, Eric-Jan. (2012)
- Bem's 'Feeling the Future' (2011) Five Years Later: Its Impact on Scientific Literature — Silva, Bruno A. (2017)
- Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project — Kekecs, Zoltan. (2023)
- Investigating variation in replicability: A "many labs" replication project — Klein, Richard A. (2014)
- Back from the Future: Parapsychology and the Bem Affair — Alcock, James E. (2011)
- Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice — LeBel, Etienne P. (2011)
- A Bayes Factor Meta-Analysis of Bem's ESP Claim — Rouder, Jeffrey N. (2011)
- Why Psychologists Must Change the Way They Analyze Their Data: The Case of Psi — Wagenmakers, Eric-Jan. (2011)
Meta Analyzed By
Cited By
- The Experimental Evidence for Parapsychological Phenomena: A Review — Cardeña, Etzel. (2018)
- Parapsychological Phenomena as Examples of Generalized Nonlocal Correlations—A Theoretical Framework — Walach, Harald. (2014)
- Follow-up on the U.S. Central Intelligence Agency's (CIA) Remote Viewing Experiments — Escolà-Gascón, Álex. (2023)
- Feeling the Future Again: Retroactive Avoidance of Negative Stimuli — Maier, Markus A. (2014)
- A Preregistered Multi-Lab Replication of Maier et al. (2014, Exp. 4) Testing Retroactive Avoidance — Maier, Markus A. (2020)
- Why Most Research Findings About Psi Are False: The Replicability Crisis, the Psi Paradox and the Myth of Sisyphus — Rabeyron, Thomas. (2020)
- We Should Have Seen This Coming — Schwarzkopf, D. Samuel. (2014)
- An Agenda for Purely Confirmatory Research — Wagenmakers, Eric-Jan. (2012)
- Evidence for Anomalistic Correlations Between Human Behavior and a Random Event Generator: Result of an Independent Replication of a Micro-PK Experiment — Walach, Harald. (2020)
Also by these authors
More in Skeptical
Cognitive Styles and Psi: Psi Researchers Are More Similar to Skeptics Than to Lay Believers
Searching for the Impossible: Parapsychology's Elusive Quest
False-Positive Effect in the Radin Double-Slit Experiment on Observer Consciousness as Determined with the Advanced Meta-Experimental Protocol
Cross-Examining the Case for Precognition: Comment on Mossbridge and Radin (2018)
N,N-Dimethyltryptamine and the Pineal Gland: Separating Fact from Myth
📋 Cite this paper
Ritchie, Stuart J., Wiseman, Richard., French, Christopher C. (2012). Failing the Future: Three Unsuccessful Attempts to Replicate Bem's 'Retroactive Facilitation of Recall' Effect. PLoS ONE. https://doi.org/10.1371/journal.pone.0033423
@article{ritchie_2012_failing_future,
title = {Failing the Future: Three Unsuccessful Attempts to Replicate Bem's 'Retroactive Facilitation of Recall' Effect},
author = {Ritchie, Stuart J. and Wiseman, Richard. and French, Christopher C.},
year = {2012},
journal = {PLoS ONE},
doi = {10.1371/journal.pone.0033423},
}