Feeling the Future: A Meta-Analysis of 90 Experiments on the Anomalous Anticipation of Random Future Events
๐ Original study โ๐ Appears in:
Plain English Summary
After Bem's 2011 study ignited a firestorm, this massive follow-up asked: does the effect hold when other labs try it? Across 90 experiments from 33 labs in 14 countries with over 12,000 participants, the answer was a surprisingly firm yes. The Bayes Factor (a measure of how strongly data favor one hypothesis over another) exceeded five billion โ wildly past what's considered decisive evidence. Even independent replications held up. Here's a fascinating wrinkle: experiments using fast, intuitive thinking worked significantly better than slow, deliberate ones โ suggesting precognition might ride on gut instinct rather than careful reasoning. Seven of eight bias tests came back clean, arguing this isn't just cherry-picked results.
Research Notes
The definitive meta-analytic follow-up to the Bem (2011) controversy, providing the strongest cumulative statistical case for the precognition effect. Central to the Feeling the Future debate (Controversy #2). The fast/slow thinking distinction offers a theoretically motivated moderator that may explain inconsistent replication results.
Meta-analysis of 90 experiments from 33 laboratories in 14 countries (12,406 participants) testing anomalous anticipation of random future events, following up on Bem's (2011) original nine experiments. The overall effect was Hedges' g = 0.09, z = 6.33, p = 1.2 x 10^-10, with a Bayes Factor of 5.1 x 10^9 greatly exceeding the criterion for decisive evidence. Independent replications yielded g = 0.06, z = 4.16, BF = 3,853. P-curve analysis estimated the true effect size at 0.20, closely matching Bem's original d = 0.22. Fast-thinking protocols (g = 0.11) significantly outperformed slow-thinking protocols (g = 0.03, ns). Seven of eight statistical tests indicated the database is not compromised by selection bias or p-hacking.
Links
Related Papers
Meta Analyzes
- Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect โ Bem, Daryl J (2011)
- Failing the Future: Three Unsuccessful Attempts to Replicate Bem's 'Retroactive Facilitation of Recall' Effect โ Ritchie, Stuart J (2012)
- Correcting the Past: Failures to Replicate Psi โ Galak, Jeff (2012)
- Feeling the Future Again: Retroactive Avoidance of Negative Stimuli โ Maier, Markus A (2014)
- Retro-priming, priming, and double testing: psi and replication in a testโretest design โ Rabeyron, Thomas (2014)
- Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli? โ Wagenmakers, Eric-Jan (2012)
Cites
- Predictive Physiological Anticipation Preceding Seemingly Unpredictable Stimuli: A Meta-Analysis โ Mossbridge, Julia (2012)
- We Should Have Seen This Coming โ Schwarzkopf, D. Samuel (2014)
- Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice โ LeBel, Etienne P (2011)
- Why Psychologists Must Change the Way They Analyze Their Data: The Case of Psi โ Wagenmakers, Eric-Jan (2011)
- A Bayes Factor Meta-Analysis of Bem's ESP Claim โ Rouder, Jeffrey N (2011)
- Too Good to Be True: Publication Bias in Two Prominent Studies from Experimental Psychology โ Francis, Gregory (2012)
- An Agenda for Purely Confirmatory Research โ Wagenmakers, Eric-Jan (2012)
Same Research Program
- Does Psi Exist? Replicable Evidence for an Anomalous Process of Information Transfer โ Bem, Daryl J (1994)
- Bem's 'Feeling the Future' (2011) Five Years Later: Its Impact on Scientific Literature โ Silva, Bruno A (2017)
- Predictive Physiological Anticipation Preceding Seemingly Unpredictable Stimuli: An Update of Mossbridge et al.'s Meta-Analysis โ Duggan, Michael (2018)
Cited By
- A Call for an Open, Informed Study of All Aspects of Consciousness โ Cardeรฑa, Etzel (2014)
- Inner Experience โ Direct Access to Reality: A Complementarist Ontology and Dual Aspect Monism Support a Broader Epistemology โ Walach, Harald (2020)
- Precognition as a Form of Prospection: A Review of the Evidence โ Mossbridge, Julia A (2018)
- Why Most Research Findings About Psi Are False: The Replicability Crisis, the Psi Paradox and the Myth of Sisyphus โ Rabeyron, Thomas (2020)
- The Experimental Evidence for Parapsychological Phenomena: A Review โ Cardeรฑa, Etzel (2018)
- Searching for the Impossible: Parapsychology's Elusive Quest โ Reber, Arthur S (2019)
- Anomalous Cognition: An Umbrella Review of the Meta-Analytic Evidence โ Tressoldi, Patrizio (2021)
- Exceptional Experiences Reported by Scientists and Engineers โ Wahbeh, Helanรฉ (2018)
Also by these authors
When the Truth Is Out There: Counseling People Who Report Anomalous Experiences
Meta-Analysis of Free-Response Studies 2009-2018: Assessing the Noise-Reduction Model Ten Years On
On the Correspondence Between Dream Content and Target Material Under Laboratory Conditions: A Meta-Analysis of Dream-ESP Studies, 1966-2016
More in Precognition
Experimental Investigation of Precognition in Yoga Practitioners
Sentiment and Presentiment in Twitter: Do Trends in Collective Mood "Feel the Future"?
Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project
A Preregistered Multi-Lab Replication of Maier et al. (2014, Exp. 4) Testing Retroactive Avoidance
Perspectives on Precognition
๐ Cite this paper
Bem, Daryl J, Tressoldi, Patrizio E, Rabeyron, Thomas, Duggan, Michael (2015). Feeling the Future: A Meta-Analysis of 90 Experiments on the Anomalous Anticipation of Random Future Events. F1000Research. https://doi.org/10.12688/f1000research.7177.2
@article{bem_2015_feeling,
title = {Feeling the Future: A Meta-Analysis of 90 Experiments on the Anomalous Anticipation of Random Future Events},
author = {Bem, Daryl J and Tressoldi, Patrizio E and Rabeyron, Thomas and Duggan, Michael},
year = {2015},
journal = {F1000Research},
doi = {10.12688/f1000research.7177.2},
}