Thu 23 May 2013
The failures of upscaling scientific publication
Posted by wgreller under Knowledge & ContentNo Comments
Research activities have come a long way. Publication of scientific output has been dramatically upscaled over the past decade through internal and external HE policies. So much so, that it has become a bubble that threatens to burst.
Everybody publishes – lots! When I say everybody, I mean entire institutions being loaded with publication duties that previously only had a teaching mission (FE colleges, teacher training or arts colleges, polytechnics, etc.). In the accumulative system, PhD students too have to produce multiple quality articles instead of the previously required (single) doctoral thesis. This adds tens of thousands of people publishing large quantities of academic papers across Europe. Furthermore, also established universities squeeze the last bit out of their researchers in order for them to remain intellectually visible in a flooded market. Papers have become the currency by which researchers and the intellectual capital of institutions are quantified and benchmarked. Hence, the more papers the better!
In the same way as the production of academic papers has exponentially increased, so has the publishing market. There are now oodles of journals that offer themselves as outlets for academic products (ranging from the unknown start-up to the dodgy scammer). And every week there will be more. In some ways, Open Access, which now finally has taken off in a bigger way, has complicated things. Authors have very little understanding where they could and should publish their stuff in order to satisfy four key demands: (1) be visible to the relevant research community, (2) not being charged for publishing, (3) providing open access to their works for others, (4) being quality assured in a transparent and accepted way.
The entire academic publishing field has been blown out of proportions and over-scaled to the extent where parts of the complex system are no longer functional and therefore prone to system failure. One of these components is the quality assurance from peer reviews. I used to get requests for reviews ever so often from established conferences and journals. I enjoyed it a lot since it forced me to read and reflect, it allowed me to help and support peers in their quest for knowledge and it kept me up-to-date. All in all a good system. However, this type of volunteer-ism and honorary work is not scalable to the extent that the present situation would demand. Reviews are unpaid extra work and lately have developed the tendency of follow-up procedures where reviewed articles boomerang back to the reviewer often several times. At the same time, my own resources should be spent on actively publishing not on reviewing (say my bosses!). It simply isn’t my job to be a full-time lector and editor, and I am sure I am not alone in this.
This situation of supply outstripping (a) demand, and, (b) resources leads, in my opinion, to a spiral of reduced quality. Part of this has to do with lack of thoroughness on part of the peer reviews and slackness in the quality selection processes. But also the relative inexperience with which some authors and reviewers approach the matter of academic publication is amplified by the lack of time for thorough feedback and support. Hence it becomes a systemic failure of the quality processes which are meant to control how much noise is produced and reviewed.











