Today’s academic publishing system may be problematic, but many argue it is the only one available to provide adequate research evaluation. Pandelis Perakakis introduces an open community platform, LIBRE, which seeks to challenge the assumption that peer review can only be handled by journal editors. By embracing a new culture of open, transparent and independent research evaluation, the academic community can more productively contribute to global knowledge.
If you asked a commercial academic publisher what services they offer in exchange for their extortionate journal subscription rates, their reply would include a short list with administration of the peer review process featuring as the unique selling point. The publisher would be lucky for the conversation to end there, but an informed and insistent questioner would point out that peer reviews are performed by external academics providing their services for free, without even soliciting any meaningful academic recognition. To make life even easier for publishers, journal editors —also working for free— often ask authors to propose a list of recommended reviewers to effortlessly expand their database of potential academic helpers. As long as reviewers remain anonymous, no one can ever tell whether or not an editor intelligently selected suitable experts in the field, or simply invited the reviewers that authors suggested in their confidential cover letters.
Managing the peer review process costs publishers next to nothing and yet it is indeed the single most important element that supports their business model and protects their revenue stream. The logic is simple. Journals use a “rigorous” peer review process to build their prestige by establishing high rejection rates —despite the fact that today online publishing and electronic typesetting could actually increase publication slots and maintain higher acceptance rates at next to no cost. Academics need to publish in prestigious journals as a means to achieve recognition and secure tenure. In exchange, they are willing to give away the copyright of their articles and to offer their review services for free. Commercial publishers take advantage of the situation by including prestigious journals in “Big Deal” subscription bundles that are given to libraries as “all or nothing” offers.
Someone could argue that there is no problem with journals rejecting 95% of submitted articles, with academics spending their valuable time (mostly paid with public money) reformatting and resubmitting the same articles over and over again, and with publishers (adding close to zero value to the whole process) enjoying millions in profits at a time of global economic crisis when libraries around the world are being forced to cut down on subscription budgets. Even if someone were to have no objection to that, what is really profoundly problematic and ultimately unacceptable is that this whole enterprise is based on the economics of scarcity — customarily applied in the context of limited material resources where value is accrued from exclusivity. Knowledge, however, is a totally different fruit. Contrary to material goods, the more knowledge is freely shared, the more value it obtains. Quoting George Bernard Shaw:
If you have an apple and I have an apple and we exchange these apples then you and I will still each have one apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas.
Today’s academic publishing model treats knowledge —in the form of the academic article— as a material good. Instead of collaborating to shape new scientific ideas and communicate them to the research community and the public in general, scholars are forced to compete for a limited number of prestigious publication slots. As a result, science advances slower and less efficiently than it should, and young researchers entering their fields with a genuine aspiration to contribute to global knowledge are soon confronted with the ruthless “publish or perish” reality. And this is something humanity cannot accept.
Publishers, journals and academics are stuck in a vicious circle with the current academic publishing model threatening to stagnate the flow of knowledge. This circle can be broken at any moment by any one of its main key players. Publishers could charge prices according to the real value they add to the process. Journals could start to care less about their prestige and increase their acceptance rates — something that can easily be accomplished without loosening their quality standards. The academic community could gain control of scholarly evaluation and communication. Time will tell which of these possibilities is the more probable. The oxymoron, however, is that in this game academics like ourselves hold both the fruit and the basket. We create the product and we certify it. Yet, we are the ones benefiting least from the “market”. We argue, that it would take as little as simply realising the power in our hands to change the entire landscape in favour of science and society. The key is peer review.
According to its advocates, the current research evaluation system may be problematic, but is the only practical one available. Indeed, many alternative peer review models have been proposed, but they all assume that “peer review has to remain under the control of academic journals”. Perhaps the time has come to challenge this assumption. No one would deny that what scientists do best is challenge world views and investigate viable alternatives. This, after all, is what has driven knowledge forward through feudal times and the Dark Ages to the Enlightenment.
The LIBRE (LIBerating REsearch) Project developed by Open Scholar C.I.C. —a not-for-profit organisation supported by a growing, open community— is one such alternative. LIBRE challenges the fundamental assumption that peer review can only be arranged and handled by journal editors. It is a free, multi-disciplinary platform that allows academic authors to invite expert peers to formally review their work. Full-text reviews are linked to the original manuscripts and the identities of both the authors and the reviewer are disclosed from the beginning of the review process. This open and transparent procedure permits direct communication and collaboration between authors and reviewers during all stages of the review. Reviewers help authors improve their manuscripts and receive recognition for their contribution as their reports are licensed and receive their own digital object identifier (DOI) to become citable items. In a further iteration, reviews themselves are also openly evaluated by other academics, providing incentives for thorough and helpful critiques, and protecting the system from potential sources of bias.
LIBRE can be thought of as an innovative experiment designed to test whether or not the academic community is ready to adopt a direct, open, independent and transparent evaluation scheme to certify the fruits of its own labour. By entrusting the handling of peer review to authors themselves, LIBRE eliminates all costs related to the research evaluation process setting it free of financial firewalls. It is our hope that the LIBRE project will encourage the spawning of other similar platforms and “green” open access repositories embracing our author-guided peer review model. Academic journals can then concentrate on the important role of soliciting and selecting verified and high quality open access scientific articles and disseminating them to specific audiences and communities.
The online platform, which will be officially launched in October 2013, was developed with the help of research grants and its maintenance depends on a great deal of voluntary work by dedicated members and minimum funding for technical support and promotion expenses. Consistent with Open Scholar’s asset lock, all further funding from foundations, grants or donations will be directly invested in the continued development and promotion of the project. The ultimate success of LIBRE depends on the preparedness of our academic community to embrace a new culture of open, transparent and independent research evaluation in order to break itself free from commercial interests unrelated to the true pursuit of knowledge.
Note: This article gives the views of the author, and not the position of the Impact of Social Science blog, nor of the London School of Economics. Please review our Comments Policy if you have any concerns on posting a comment below.
Pandelis Perakakis is a clinical psychophysiologist currently doing postdoctoral research in Experimental Economics. He is an active advocate of Green Open Access and proponent of a new research evaluation model termed “Author-guided Peer Review”. In 2012, together with physicist Michael Taylor and Biologist Varvara Trachana, he co-founded Open Scholar C.I.C. with the vision to promote a new culture of openness and transparency in scholarly communication. Follow the LIBRE Project on Twitter: @libreapp
Thanks for this post. This is a really important debate.
I have just started reviewing for the Open peer review journal of Perspectives in Applied Academic Practice and I must say that I find the process of open peer review quite refreshing. It keeps the process of reviewing honest, but I can also see how it could go the other way around. No system is perfect; still these initiatives are necessary, especially in the context of the so called digital economy/society.
The commercial academic publishing business doesn’t stop to amaze me. Their business model is so flawed and yet so powerful. It would probably never work in the “real world” though…!?. Yet, it has such a strong currency in academia. Hence, I think it is also important to look at why this is so. Although I am very supportive of new initiatives that push the boundaries and question the existing structures (it keeps us on our toes…), I think it’s equally important to think how these initiatives can and will influence policy and thus transform academic practices and approaches.
For instance, in my humble opinion, there is a lot of misunderstanding about open access and the ideas and practices that underpin the Open Access Movement which, as you pointed out here, is far more complex than making knowledge available on a website. There is a whole set of values and principles that inform this movement, being transparency one of them. Nonetheless, Foundations like the Wellcome Trust spend millions “balling out” academic papers from closed journals – in name of openness – instead of instigating effective and sustainable change by using that money to not only create publishing capacity in academia, but also instigate new practice. Digital scholarship is a mind-set.
“Tradition” may well be one of the reasons why the current publishing business model is still widely accepted. It was needed in the past. Yet, the emergence of new technologies has meant that our needs have started to change and so should our practices. However, that will not happen until academia rethinks the way it accumulates symbolic capital (prestige, or the myths that surround the idea of prestige…). With the REF so eminent in the UK, it is visible that the most valuable “academic assets” are publications. And the prestige that is conferred to certain journals may weigh on the decision of academics when choosing where to publish. Thus, it is important that these (hidden) rules of the game change so that academia feels freer to experiment with these initiatives. I hope that new research exercises will contemplate digital forms of scholarship. And I hope this project will have a positive impact on it. I shall be following it closely.
Thank you Cristina for your comment.
I agree that we cannot expect scholars to change their practices while the rules of the game (not so hidden I would say) dictate that they are evaluated based on publications in prestigious journals. A top-down transformation in scholarly evaluation by University committees and funding agencies is essential for any true revolution towards a more open and ethical model to take place. Let me note, however, that an important advantage we see in LIBRE is that scholars can give it a try without any risk. Contrary to submitting manuscripts to “not-so-prestigious” open access journals, using a peer review service like the one we develop does not prohibit authors to later send the same manuscript to a traditional journal of their choice. We are currently building a list of journals that agree to accept for publication articles previously reviewed in LIBRE. This way authors have the choice to accumulate open critics by experts before they even submit their manuscripts for formal publication. So, imagine a close future when a University committee wants to select the best scholar for a position and has to compare two CVs one with an article published in a prestigious journal and another with an article not so well-published, but that has received a formal approval by the world’s most renowned experts in its subject. Especially considering the escalation of multidisciplinary research, LIBRE gives authors the option to seek approval, or comments for improvement, by as many experts as they want in order to cover all methodological aspects of their work. More reviewers for the same paper also means that each reviewer will not have to necessarily assess the entire work, but only the parts that fall within his/her area of expertise.
Having previously reviewed your papers and secured formal approval by peers makes an article a stronger candidate for publication and also helps journals make better-informed and less risky decisions on which articles to publish. However, if this new workflow of free preprint open peer review is widely adopted by the community, we will hopefully reach a stage when the extra journal-handled peer review will have little to offer. It is only when we manage to decouple quality control from journals, that the symbolic capital of prestige —and with it a publishing business model that is doing a great harm to scientists, science and the society— will start losing its value.
I also strongly agree with you that “digital scholarship is a mindset” and believe that creating efficient tools is only one side of the story. Following LIBRE’s release we plan to organise and participate in conferences, workshops and other meetings to discuss all these open initiatives emerging in the academic landscape and inform our colleagues on how they can be open, ethical and not academically isolated. It is our hope that more like-minded researchers will join forces in this effort as we will also try to be present to support similar initiatives.
Harnad, S. (2008) Flight-test before you fly. Comment on “A XXI-century alternative to XX-century peer review”, real-world economics review 47: 252-253
________ (2010) No-Fault Peer Review Charges: The Price of Selectivity Need Not Be Access Denied or Delayed. D-Lib Magazine 16 (7/8).
Thank you Stevan for these interesting references.
With your permission I will quote an excerpt from your comment to Ietto-Gillies:
“Systems like the one proposed by Ietto-Gillies have been proposed many times. What is needed is to test them, to demonstrate that they are capable of generating at least the same standards of quality and useability that we have now in each field — and also that they are sustainable and scalable. (Everything new works at first, for a while.)”
We couldn’t agree more!
This is interesting and has a lot of good ideas — thanks for posting!
The one thing that concerns me is letting go of anonymous review. I’m in a field (Philosophy) that’s generally thought to be biased in various ways and in which there is a serious under-representation of women. Anonymous review serves two purposes for me: it allows my work to be evaluated in a more objective, unbiased way, and it also grounds an implicit reply to those who think women succeed only because they get special treatment (since the review is anonymous, publication in top journals can’t be caused by a goal of including more women).
I’ve love to see anonymity, especially for students and junior scholars, stay part of the process. Thanks again –Patricia.
This may be interesting as well: a software platform that I have developed in the past weeks, motivated by my own experience as a PhD student:
DocRev – http://www.docrev.org
Briefly, the idea is to transfer the effort of reviewing documents to a crowd-sourced platform: a user provides feedback to other users’ documents, and in return obtains feedback for his own documents.
My motivation stems from “yet another review” of a research paper of my own that I had already read many times for re-submission. At the time I was already so fed up of reading it that I’d rather read someone else’s work instead, hoping that another person would instead read my own work.
Not only would that be refreshing, not to be reading always the same thing and maybe learn something new, but it would also be way more productive to catch problems in the document with a fresh pair of eyes.
In fact, this is just a use case specific to research, but I believe the concept is applicable to any area and types of documents. Examples:
– Send a formal letter to a lawyer, which requires familiarity with certain terms. Why not ask a law student or even a young lawyer to look at it in exchange for our own expertise?
– Maybe you wrote a blog post or some meaningful content and would like to get some feedback before publishing it.
– You have some work in progress in a specific area for which you know no one and would love some feedback.
– Camera-ready research papers, which you have read countless times, but that probably still have some bugs/typos.
– You are sending an application to a job offer / grant / project, and would love a review of it.
If you are still reading, then I really encourage you to try it out:
DocRev – http://www.docrev.org