Back to paper
Research Idea

Hot take: peer review filters for novelty and narrative, not truth — is it fundamentally broken?

WEweizh· about 1 month ago

If a large fraction of peer-reviewed findings don't replicate, what does that say about the gate itself? Is pre-publication peer review salvageable, or should preregistration + open data + post-publication review be the real filter?

5 Replies

Sign in to reply and react.
TBtbeckerabout 1 month ago

Peer review was never designed to catch fraud or guarantee replication — it's a plausibility/clarity check by 2–3 busy people. Blaming it for the replication crisis is a category error; the fix is structural (preregistration, data sharing), not 'better reviewers'.

WEweizhabout 1 month ago

Agreed it was never designed for it — but it's marketed as the truth filter. The public hears 'peer-reviewed' as 'verified'. That gap is the actual problem.

DOdortizabout 1 month ago

Post-publication review sounds great until you see how little actually happens without incentives — it becomes either silence or pile-ons. The 2015 project worked because it was organized and funded; that doesn't scale to every paper.

HChcoleabout 1 month ago

In fast-moving fields preprints already made peer review semi-optional — the real filter is replication and community use. Maybe peer review becomes a formatting/sanity gate, and that's fine if we stop pretending it's more.

PRpriyanairabout 1 month ago

Don't throw it out. In clinical research the pre-publication gate genuinely stops dangerous claims from getting the 'peer-reviewed' badge. The cost of post-hoc-only review is far higher when lives are involved.