Rethinking Peer Review As The World Peer Reviews Claimed Proof That P≠NP

from the there-are-a-lot-more-peers dept

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community. Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis. While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

We recently discussed how incredibly broken the traditional scientific journal system is, in terms of how they tend to lock up access to information. However, that left out a much bigger concern: the peer review system they use doesn't always work very well. There is, of course, the famous case of Hendrik Schön , who was the toast of the physics world, until it was discovered that his "breakthroughs" were frauds -- even though they were peer reviewed. But that, of course, is an extreme case. Even outside of that, though, peer review has always been somewhat questionable, and many have warned in the past that it's not particularly reliable or consistent in judging the quality of research.This week, the world has been taken by storm by claims from Vinay Deolalikar, that he has proved P≠NP , one of (if not) biggest problem in math and computer science which has potentially huge implications (pdf). However, what's interesting is that the paper started getting a ton of attention prior to any sort of peer review... but all of the attention around it has resulted in people (experts and non-experts alike) around the world beginning to take part in a self-organizing peer review on the fly.This is leading some to point out that this seems to be a much better method of peer review and should be looked at more seriously (found via Glyn Moody ). Apparently, people are realizing that a much more open post-publication peer review process, where anyone can take part, is a lot more effective:The post goes on to discuss some of the pros and cons of this kind of post-publication peer review, and to respond to some of the claimed challenges to it as well. Obviously, this particular paper is a bit different in that the fame around the problem, and the interest in the story itself has a lot more people willing to just go and dig into the proof, but that doesn't mean there aren't some useful lessons to be learned here about getting past the old and increasingly ineffective method of peer review used in many places today.

Filed Under: p=np, peer review, post publication