Thursday, July 26, 2007

A broken peer-review process

More insidious, in my view, is the gradual morphing of the referees from evaluators to anonymous co-authors. Referees request increasingly extensive revisions. Usually these represent improvements, but the process takes a lot of time and effort, and the end result is often worse owing to its committee-design. Authors, knowing referees will make them rewrite the paper, are sometimes sloppy with the submission. This feedback loop - submitting a sloppy paper since referees will require rewriting combined with a need to fix all the sloppiness - has led to our current misery. Moreover, the expectation that referees will rewrite papers, combined with sloppy submissions, makes refereeing extraordinarily unpleasant. We - the efficiency-obsessed academic discipline - have the least efficient publication process...

Consequently, Economic Inquiry is starting an experiment. In this experiment, an author can submit under a 'no revisions' policy. This policy means exactly what it says: if you submit under no revisions, I (or the co-editor) will either accept or reject. What will not happen is a request for a revision.
--R. Preston McAfee, editor of Economic Inquiry, on an attempt at reform a broken system

No comments: