Anomalous Cognition: An Umbrella Review of the Meta-Analytic Evidence
π Original study βπ Appears in:
Plain English Summary
Think of this as the ultimate mega-study of psychic perception research β a review of reviews. The authors pulled together 11 major meta-analyses spanning 1989 to 2021, covering a whopping 928 individual studies and over 80 years of experiments on so-called anomalous cognition (basically, ways people might pick up information without using their normal senses). The headline finding? Nearly every effect they examined came out statistically significant β 15 out of 16 reported effects cleared the bar, which is pretty remarkable on its face. The one exception was a type of precognition (knowing the future) tested using slow, deliberate guessing in forced-choice setups, where subjects essentially pick from a fixed set of options. The size of the effects varied wildly depending on the setup. Forced-choice clairvoyance experiments β where people guess which hidden target they're looking at β showed a tiny effect of 0.005, while remote viewing experiments using open-ended, free-response methods produced an effect nearly 80 times larger at 0.39. The single strongest pattern in the data was that experimental setup matters enormously. When participants were in altered states of consciousness (like meditation or the ganzfeld, a sensory deprivation technique) and could describe what they perceived freely, effects were largest. When they were in a normal waking state picking from fixed options, effects shrank to almost nothing. The correlation between these conditions and effect size was a striking 0.81. Here is an interesting wrinkle worth noting: between 54% and 81% of individual studies within each meta-analysis were themselves not statistically significant. The authors argue this actually counts in their favor β if researchers were cherry-picking or tweaking results, you would expect more individual studies to look impressive, not fewer. That said, both authors have skin in the game, having contributed to several of the meta-analyses under review, so their independence as judges of this evidence deserves some scrutiny.
Research Notes
The most comprehensive single synthesis of psi meta-analyses in the library, covering 80+ years and 928 studies across all major anomalous cognition paradigms. Both authors are themselves authors of several included meta-analyses, which should be weighed in assessing independence. Directly relevant to Controversies #1, #2, #3, and #10.
Umbrella review of 11 meta-analyses conducted between 1989 and 2021, encompassing 928 studies of anomalous cognition across six states of consciousness and three response types. All 16 reported effect sizes were statistically significant except for slow-thinking forced-choice precognition (ES = 0.03). Effect sizes ranged from 0.005 (forced-choice clairvoyance) to 0.39 (remote viewing free-response). State of consciousness and response type were strong moderators (Spearman rs = .81, p = 1.9 Γ 10β»β΄): altered states with free-response protocols and physiological anticipation measures yielded the largest effects, while forced-choice paradigms in normal consciousness yielded the weakest. Between 54% and 81% of individual studies in most meta-analyses were non-significant, which the authors argue militates against questionable research practices.
Links
Related Papers
Meta Analyzes
- "Future Telling": A Meta-Analysis of Forced-Choice Precognition Experiments, 1935-1987 β Honorton, Charles (1989)
- Predictive Physiological Anticipation Preceding Seemingly Unpredictable Stimuli: A Meta-Analysis β Mossbridge, Julia (2012)
- Meta-Analysis of Free-Response Studies 2009-2018: Assessing the Noise-Reduction Model Ten Years On β Storm, Lance (2020)
- Feeling the Future: A Meta-Analysis of 90 Experiments on the Anomalous Anticipation of Random Future Events β Bem, Daryl J (2015)
- On the Correspondence Between Dream Content and Target Material Under Laboratory Conditions: A Meta-Analysis of Dream-ESP Studies, 1966-2016 β Storm, Lance (2017)
- Predictive Physiological Anticipation Preceding Seemingly Unpredictable Stimuli: An Update of Mossbridge et al.'s Meta-Analysis β Duggan, Michael (2018)
- Stage 2 Registered Report: Anomalous Perception in a Ganzfeld Condition - A Meta-Analysis of More Than 40 Years Investigation β Tressoldi, P.E (2024)
Cites
- Meta-Analysis of Free-Response Studies, 1992β2008: Assessing the Noise Reduction Model in Parapsychology β Storm, Lance (2010)
- Does Psi Exist? Lack of Replication of an Anomalous Process of Information Transfer β Milton, Julie (1999)
- Inner Experience β Direct Access to Reality: A Complementarist Ontology and Dual Aspect Monism Support a Broader Epistemology β Walach, Harald (2020)
- A Bayes Factor Meta-Analysis of Recent Extrasensory Perception Experiments: Comment on Storm, Tressoldi, and Di Risio (2010) β Rouder, Jeffrey N (2013)
- Does Psi Exist? Replicable Evidence for an Anomalous Process of Information Transfer β Bem, Daryl J (1994)
- An Assessment of the Evidence for Psychic Functioning β Utts, Jessica (1996)
- Information and Uncertainty in Remote Perception Research β Dunne, Brenda J (2003)
Also by these authors
Telecommunication Telepathy: A Meta-Analysis
Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project
A Preregistered Multi-Lab Replication of Maier et al. (2014, Exp. 4) Testing Retroactive Avoidance
More in Meta Analysis
π Cite this paper
Tressoldi, Patrizio, Storm, Lance (2021). Anomalous Cognition: An Umbrella Review of the Meta-Analytic Evidence. Journal of Anomalous Experience and Cognition. https://doi.org/10.31156/jaex.23206
@article{tressoldi_2021_umbrella_review,
title = {Anomalous Cognition: An Umbrella Review of the Meta-Analytic Evidence},
author = {Tressoldi, Patrizio and Storm, Lance},
year = {2021},
journal = {Journal of Anomalous Experience and Cognition},
doi = {10.31156/jaex.23206},
}