Skip to main content

Addressing Researcher Fraud: Retrospective, Real-Time, and Preventive Strategies — Including Legal Points and Data Management That Prevents Fraud

📄 Original study
Kennedy, James E 2024 Current Era methodology

📌 Appears in:

Plain English Summary

What if the biggest threat to science isn't bad hypotheses but researchers faking their data? Kennedy tackles this head-on, drawing from decades of hands-on experience -- including running an actual sting operation back in the 1970s and spending 15 years in FDA-regulated drug trials where data integrity is literally a legal requirement. He lays out three ways to fight research fraud. First, the usual approach: investigating after someone blows the whistle. Problem is, by then the evidence is murky, standards are loose, and you often can't even prove who did it. Second, catching cheaters in the act with sting operations -- beautifully conclusive but almost impossible to pull off in practice. Third, and this is the real gem: preventive measures borrowed from the pharmaceutical world that most academic researchers have simply never adopted. Kennedy spells out eight specific practices -- things like keeping tamper-proof audit trails, locking down who can touch the raw data, validating your software, running independent audits, and making datasets public. He even audited a flagship parapsychology study (the Transparent Psi Project) and found a significant software bug lurking in what was supposed to be a gold-standard registered study. That's a wake-up call. He proposes a new badge system so readers can instantly see which studies actually meet these standards. And here's the kicker for the future: AI is about to make fraud dramatically harder to detect, raising the stakes for getting these safeguards in place now.

Research Notes

Kennedy's most comprehensive methodological paper, drawing on a personal 1970s sting operation and 15 years in FDA-regulated clinical trials. Directly relevant to parapsychology: the eight preventive practices are a concrete checklist for evaluating psi studies' data integrity. Kennedy audited the Transparent Psi Project (Kekecs 2023) and found a significant software error even in that high-quality registered study. Complements kennedy_2017_experimenter_fraud and kennedy_2024_falsifiable_research as the capstone of his research integrity work.

Policy and practice review analyzing three strategies for addressing researcher fraud: (1) retrospective investigations after allegations — common but vulnerable to post-hoc bias, low evidentiary standards, and inability to identify perpetrators; (2) real-time sting operations — conclusive when feasible, but rarely practicable; (3) preventive data management practices from FDA-regulated clinical trials — largely absent from academic research. Eight preventive practices are described: archiving raw data, audit trails, restricted data access, software validation, quality control, blinding with preregistered analysis programs, research audits, and public raw data. Proposes an 'error-controlled data management' badge for studies meeting these standards. AI is identified as a looming escalation of fraud sophistication.

Links

Related Papers

Also by these authors

More in Methodology

📋 Cite this paper
APA
Kennedy, James E (2024). Addressing Researcher Fraud: Retrospective, Real-Time, and Preventive Strategies — Including Legal Points and Data Management That Prevents Fraud. Frontiers in Research Metrics and Analytics. https://doi.org/10.3389/frma.2024.1397649
BibTeX
@article{kennedy_2024_research_fraud,
  title = {Addressing Researcher Fraud: Retrospective, Real-Time, and Preventive Strategies — Including Legal Points and Data Management That Prevents Fraud},
  author = {Kennedy, James E},
  year = {2024},
  journal = {Frontiers in Research Metrics and Analytics},
  doi = {10.3389/frma.2024.1397649},
}