Retractions play an important role in research communication by highlighting and explaining how research projects have failed and thereby preventing these mistakes from being repeated. However, the process of retraction and the data it produces is often sparse or incomplete. Drawing on evidence from 2046 retraction records, Quan-Hoang Vuong discusses the emerging trends this data highlights and argues for the need to enforce reporting standards for retractions, as a means of de-stigmatising retraction and rewarding practising integrity in the scholarly record.
While it seems obvious that withdrawing papers, which contain errors or misconduct, helps to keep the literature healthy, researchers want to avoid retractions at all costs. Indeed no editorial practice in academia can affect an academic reputation as much as a retraction. The stigma is rooted in the fear of every researcher that a retracted article, which would remain accessible online with an additional tagline of retraction notice, is like a scar seared into the public profile of an author. But, just as every scar is a reminder of a past mistake or injury, every retraction, regardless of the reasons – an honest mistake or a deliberate fraud, also has something to teach us.
The good
A recent analysis of 2,046 retraction records, cleaned upon extraction from the Retraction Watch (RW) Database and major publishers’ websites, brings attention to how retractions are not always initiated by the editors and publishers, but also by the authors themselves. As Figure 1 shows, although half of the retraction notes do not reveal the initiators, 301 notices, or 15%, were made solely by the authors. These ‘heroic souls’, despite knowing the stigma associated with a retracted article, willingly make that request and even provide reasons for why they think the findings should be removed from the literature. If between 2008 and 2016, the number of such ‘heroic acts’ was consistently below 10 each year, by 2017 and 2018, it had spiked to 27 and 55, respectively. At first look, this could spark concerns about the rising number of inadequate publications. Yet, one should also be hopeful that the competitive world of academia has not completely extinguished scientists’ motivations for genuine self-correction and transparency.
Figure 1. Source: Learned Publishing
The bad
The overall landscape, however, is not so optimistic. More worrying signs emerge in Figure 1 when one looks at a large number of retraction initiators (53%) and a small number of retractions (11%) mutually agreed by the editors and the authors. Even though publishing retraction notes is a required practice, there is clearly a lack of consistency and consensus across journals in the writing of notice content. For instance, the Committee of Publication Ethics (COPE), an established organisation in publishing best practices with thousands of journals and publishers as members, does recommend the notes to disclose who is retracting the paper and their reasons, but this practice is not enforced well enough in practice. Digging deeper, my study confirmed the obscurity in disclosing the person who first requested the retraction. This means that the 91% of retracted articles with adequate notes detailing the reasons still fall short of the COPE recommendation.
Knowing who initiated the retraction is not merely a matter of curiosity, but also one of acknowledgement. It benefits the authors who bravely admit their errors as much as their fellow researchers, who would look up to such candidness and realise not all retracted papers are related to scientific misconduct. The more retracted papers overlook this piece of information, the more suspicion they garner, and consequently, the more injustice is done to authors who honour the self-correcting spirit of science in coming forward.
The ugly
It takes courage to own up to one’s mistakes as much as to be self-reflective of one’s shortcomings. A close-up analysis of 434 retracted articles shows the devastating loss of a limitation section in a research paper. To write a limitation section is to self-acknowledge the weaknesses, and ultimately, represents an expression of humility and readiness for improvement. Yet, a strict categorisation yields only 8 articles with this section, and even a more flexible approach that counts some kind of self-evaluated ‘discussion’ or ‘future research directions’ gives only 38 articles. What is the correlation between these numbers and retraction? Remarkably only four of the 38 retracted articles touch on weaknesses that to different extents reflect the actual reasons for withdrawing the articles.
By overlooking the ugly side of a research project, researchers are giving up the chance to re-examine it, an act that is essentially counter to the critical nature of scientific research. The beauty in science does not lie in the eyes of the beholders as conventional wisdom would have it, but instead in our commitment to upholding its values and ideas. It is thus important to also own up to one’s ugliness in a project, a step that may prevent the future embarrassment of a more egregious error.
Conclusion
Retracted papers, no matter how undesirable they are, poke right at the heart of scholarly publishing. A serious existential question arises regarding the health of the industry: What to do if an author is not coming forward to recall an inaccurate published paper, and the editorial board which accepts the paper is not aware of such inaccuracy or misconduct? Are we doomed to rely entirely on the heroic souls to be open about their shortcomings?
After all, scientists are humans, and humans are fallible. It is unavoidable that our research has its limitations and may be retracted under certain circumstances. When a retraction happens, scientists and editors/publishers alike should cooperate to make the information as detailed and transparent as possible.
This post draws on the author’s article, The limitations of retraction notices and the heroic acts of authors who correct the scholarly record: An analysis of retractions of papers published from 1975 to 2019, published in Learned Publishing.
Note: This article gives the views of the author, and not the position of the LSE Impact Blog, nor of the London School of Economics. Please review our comments policy if you have any concerns on posting a comment below.
Featured Image: Steve Johnson, via Unsplash
Very thank Dr. Vuong Quan Hoang for the research! He has provied useful and meticulous information for scholars on many aspects of retraction.
Thanks. I realize your comment was the first of all.
Many thanks to the author for sharing your thoughts on this important issue. Very interesting and thought provoking for all researchers.
It is with great honor for me to serve the scientific community. Thanks.
Reforming the retraction practice is important for the health of science. This work pushed the conversation forward. Thanks the authors for interesting insight.
I can’t agree more with you.
An article that was published today named “Characteristics of retracted articles based on retraction data from online sources through February 2019” (DOI: https://doi.org/10.6087/kcse.187), which provides an overview of retracted articles. This is a work that I was fortunate to collaborate with Dr. Vuong.
Evidently, the data is all there for us to learn from. And we should make a good use of the retraction database, and previous works of RetractionWatch and other scholars.
Yes, we do learn from previous studies and our colleagues’ successes and failures. Many thanks.
Retraction is crucial part of academic publishing. However, it might be just the floating part of the iceberg. Even though it is very difficult to define the sinking part of the iceberg, looking at the good, the bad the the ugly of the floating part also inform us proper insights so we can imagine the giant shadow of the picture. Many thanks to the author for such a meaningful contribution.
Thanks for your thoughtful comment.
Thanks to the author for an interesting and valuable paper.
Congratulations!
Thanks for your words. I hope the analysis is useful.
Many thanks to Dr. Hoang for useful and interesting knowledge about retraction and heroic souls. Actually, mistakes are indispensable in research and academia. I hope to see more heroic acts in the future.
This is an interesting article indeed. Notices of retractions are part of the academic system. Those self-confessing to their mistakes are the good ones. We are all humans and mistakes can occur.
Bashar Malkawi
Researchers tend to shy away from talking about retractions but this article has shown that retractions aren’t always bad. Understanding where the retraction practice falls short will help academic publishing improve itself in the long run. Thanks to the author for this timely piece.
thanks to the author for concerning on an important issue. i agree with the idea that scientists are humans and humans are fallible. but Science is a field that requires accuracy and continuous development. Therefore, researchers need to understand their own research.
Very well pointed out Dr. Vyoung. We should try to de-stigmatize retraction. It would indeed be a great idea if authors pen down study limitations of their study so that there is future scope of improvement. A retraction is also an indication that an attempt was made but needs refinement. Rather than tarnishing social image, researchers should best make use of retractions such that science remains untainted!
Thank you, Harshad. Your points are completely valid and well made.
In the ‘publish and perish’ culture, if every researcher could perform such ‘heroic act’, it would be beneficial to not only the public but also the scholarly community. Many thanks to the author for giving precious insights into retraction papers.
I am totally agree with the author. I might think that paper retraction is the scar of a researcher’s life. However, an act of retraction to some extend should help especially retractions are due to research misconduct.
I’ve never thought about the value of retraction before. The retraction practice could help improving future research and works. Thanks to Dr. Vuong for sharing the great idea.
Just as you said, to admit a mistake needs tremendous courage but this will start a new improvement. One step back, two steps forward. Many thanks for such an insightful and inspiring post.
Very interesting. Makes me wonder if a “market place of journals” will result when we see if certain journals/publishers are more prone to retractions? Is that a lead to positive thoughts about a given journal (“keeping the profession sharp”) or to concerns that a journal may be unworthy of authors’ submissions? (“a pattern of sloppiness”)?
We need more eye opening pieces like this.
Thank you, Dr. Napier. I really like your questions, which can lead to more thoughts about retraction and the perceived image of journals. Many thanks!
As a non-scientist, I got to know about the definition of “retraction paper” through a TV show. My first impression was that it’s something very rare since I believe there must always be a lot of attention in publishing a paper. About a month ago when I read this article, I was pretty surprised to discover retractions have become more frequent, and that there’s even an ugly side to it. Yet, that was it. However, during this moment of public health crisis, when new findings are frequently reported and later contradict initial ones, I find myself reread this article and relate to it to some extent.