It has become increasingly clear that prevailing academic incentive structures have a potentially damaging and distorting effect on the nature of academic debates. Portia Roelofs and Max Gallien use the example of a controversial recent journal publication to illustrate how deliberately provocative articles have the capacity to hack academia, to privilege clicks and attention over rigour in research. This is consistent with equally troubling trends in the wider news media; where equal prominence is seemingly always afforded to extreme opposing views, where actual progress in debates becomes impossible, and false dissent is created on issues which are overwhelmingly sites of academic consensus.
Last week, development studies journal Third World Quarterly published an article that, by many common metrics used in academia today, will be the most successful in its 38-year history. The paper has, in a few days, already achieved a higher Altmetric Attention Score than any other TWQ paper. By the rules of modern academia, this is a triumph. The problem is, the paper is not.
The article, “The case for colonialism”, is a travesty, the academic equivalent of a Trump tweet, clickbait with footnotes. Its author, Bruce Gilley, a professor at the Department of Political Science at Portland State University, sets out to question the “orthodoxy” of the last 100 years that has given colonialism a bad name. He argues that western colonialism was “as a general rule, both objectively beneficial and subjectively legitimate”, and goes on to say that instead of taking a critical view of colonial and imperial history, we should be “recolonising some areas” and “creating new Western colonies from scratch”.
Image credit: [205/365] Bait (Explored) by Pascal. This work is licensed under a CC0 1.0 license.
So how did this article rise to such prominence and apparent success? Arguments for colonialism have been made in academia before; however, Gilley’s article contributes no new evidence or datasets, and discussing its empirical shortfalls and blindness to vast sections of colonial history would go far beyond the scope of this post. Thankfully, this is currently being done by some of the many scholars to have produced excellent work on colonialism over the past decades – although, by doing so, they will be further driving up the citation count and impact metrics of the original publication. Indeed a petition calling for the article’s retraction has garnered over 10,000 signatures, and many of the journal’s editorial board have resigned.
Of course, none of this is accidental. It is a well-planned provocation, an argument that feeds off the criticism it is designed to create, and references it as evidence of the prevailing “orthodoxy”. If this sounds familiar, this is exactly the same strategy with which the alt-right movement has hacked its way into public debates. The article even replicates its trademark victimhood and brazen rewriting of history by claiming that colonialism has had a “bad name” for the last hundred years, and thereby backdating what the author perceives to be a politically correct obsession to a time when colonialism was still official government policy in many states.
Surely, these views are not entirely new. That they exist is not shocking. We are slowly getting used to the alt-right. However, that these ideas and strategies, distilled into academic writing, not only get published but immediately jump to the top of some of the key metrics we use to identify success, influence, and “impact” in academia – this is chilling. Because this means not only that academia can be hacked, but that it already has been.
This article represents the culmination of broader trends in academia: from marketisation, to impact, to the promotion of artificially adversarial debate. From the late 1990s, universities have been under pressure to operate more like businesses. Rather than existing in their own comfy bubble, politicians demanded that universities face the bracing winds of the market and earn their keep. Students became consumers, big companies increasingly set the agenda for publicly funded research, and academics were to be subject to the same accountability and incentives as, say, a call-centre worker. Academics have to publish. In order to rank articles against each other, the world of academia had to create a universal way of quantifying how good an article is: hence the citation index. Indexing platforms like Scopus, Web of Science and Google Scholar record how many other articles or books cite your article. The idea is that if a paper is good, it is worth talking about. The only thing is, citation rankings count positive and negative references equally.
But this style of quantifying how good an article is pales in comparison to what has been done under the “impact agenda”. Initially spurred by the desire for professors to reach out and engage with the world outside the “ivory tower”, impact came to be measured by blogs, page views, download stats, and tweets. Academia is replicating the structure of the mass media. Academic articles are now evaluated according to essentially the same metrics as Buzzfeed posts and Instagram selfies. In fact, the impact factor is an especially blunt example of online metrics: Reddit, Youtube, and Imgur at least allow users to up-vote or down-vote posts.
The result is to dilute the idea of impact to simply publicity. And as we all know, all publicity is good publicity. (It is worth noting that Gilley lists his “scholarly impact metrics” on his CV above any of his publications.) And it’s deadly serious: how many likes your article gets is not simply a matter of vanity but is ingrained into the system of academic rewards and respects; whether when applying for promotions, jobs, or research funding. If your job prospects depend on clicks, you’d be stupid not to write clickbait.
But it’s not just an obsession with rankings and hits that leads academics to write extreme and reductive articles, and academic journals to publish them. The Gilley article reflects another, equally pernicious trend in academia. Increasingly academic debates are reduced to an adversarial “for and against”. This too mirrors movements in the news media. In search of a myopic idea of “balanced debate”, browbeaten news shows bow to the idea that the truth is always “somewhere in the middle” of two extreme opposing views. This renders actual progress in debates impossible. It creates false dissent on issues which are overwhelmingly sites of consensus, like climate change, and it stops debates from developing beyond their starting premise.
When academia is thus framed as a confrontation, it favours confrontational people. This has gendered and racialised effects. We live in a world where young boys are conditioned to be louder and more outspoken than girls; where “stereotype threat” means that black people have to be on guard against being seen to confirm stereotypes that they are aggressive. In universities, this translates into departments which are perhaps gender-balanced in number, but where men’s work is systematically rewarded at a higher rate, and black and minority ethnic academics are almost invisible. The sort of sensational articles that get hits – like Gilley’s – are those for which white men are lauded, while everyone else is told to get on and do some proper work.
Sometimes, a system reaches a point when its output is so surprising, so concerning, so against its function and mission, that a fundamental rethinking of the system itself becomes imperative, that we need to say “OK, let’s stop everything and figure out where we went wrong”. Academia serves truth and social justice best when it acts as a counterweight to the hysteria of the 24-hour news cycle. The success of articles like Gilley’s show that, unless something changes, good research may go the way of good journalism: all that is solid dissolves into clickbait.
Note: This article gives the views of the author, and not the position of the LSE Impact Blog, nor of the London School of Economics. Please review our comments policy if you have any concerns on posting a comment below.
About the authors
Portia Roelofs is an LSE Fellow in the Department of International Development at the London School of Economics, where she obtained her doctorate. She also has degrees from the University of Oxford and SOAS, University of London, and has conducted research at the universities of Maiduguri and Ibadan, Nigeria. She works on the politics of development with a focus on Southwest Nigeria. Her website is www.portiaroelofs.com
Max Gallien is a PhD Candidate in the Department of International Development at the London School of Economics. He holds an MPhil in Modern Middle Eastern Studies, and a BA in Politics, Philosophy and Economics from the University of Oxford. He works on the political economy of North Africa with a focus on informal economies.
Good piece. I have published an article in this journal, a while ago, 2003. Since then it has had 160 citations, not stellar but not bad. I will never submit for this journal again, nor will I review for it, nor will I encourage doctoral students to submit or cite from it without extreme caution, and only in circumstances where there is no citation.
This is all precautionary; my work, and that of my students will not sustain work that lack rigor, or a gaming of the system.
This ‘hack’ may bring short-term benefits for the journal, but it has destroyed its credibility, past and present.
Thank you for this important post. I would add that Gilley’s ridiculous piece represents an important change in the dynamics of what can be called “alt-scholarship,” which I think came to the fore around the lead-up to the Iraq invasion but is also prominent with climate change denial and other issues where the vast preponderance
of scholarship argues one thing but certain economic and political interests prefer a different discourse. Until recently such arguments were confined to right wing and corporate-funded think tanks, military/security establishments, a few “academics” with positions at universities, and equally few marginal if well-funded journals. while this alternative intellectual universe was marginalized from mainstream scholarship, it had incredible political power and in fact shaped US policy to support the invasion of iraq, for example. it also began to penetrate the margins of academia through offering well-funded positions to scholars who otherwise would not find work, such as through HTS and other “kinetic” research.
But now we see this kind of non-sense penetrating to the heart of the humanities. that’s pretty pathetic, and the editors of TWQ who allowed this to be published after it was rejected on scholarly grounds need to be fired immediately. if rank economic incentives now determine even scholarship on these issues, it seems all really is lost.
It does appear to be click bait since empirically the article is a complete mess. I go into a bit more detail on the factual problems at the link below.
http://jpohl.blogspot.com/2017/09/first-thoughts-on-bruce-gilley.html
Agree with the comments. This case makes the application of publication ethics (through COPE) all the more necessary. In addition, it brings into question for development studies scholars, where to publish. I taught in the same Department as the authors of this blog over a decade ago, and I was caught up in the same publication frenzy that all scholars experience [until they approach retirement, perhaps]. This directs you to top journals with good impact factors (IFs). We all know what those are in development studies. They are all owned by the big commercial publishers, like the one in this case. A movement to ignore those journals and publish elsewhere, buttressed with support from senior scholars who are the ones assessing promotions and job applications, is well overdue. It began with the ‘Academic Spring’ of 2012, but has not been sustained and now with about 70% of WoS listed articles now being published by the big five, if anything the diversity in journal publishing outlets has worsened and the commercial value of publishing has increased – good profits to be made from ‘big deals’ sold to libraries, or high APCs. I run a journal that asks for and receives no funding from anybody, and academics contribute their time willingly. It also sits comfortably in the rankings of citations, if anybody cares. This is one way forward.The ‘journal flip’ advocated by Sir Timothy Gowers, could work in this case. We don’t kneed the likes of T&F and Elsevier. Especially in a socially conscious field like development studies. https://gowers.wordpress.com/2017/07/27/another-journal-flips/
This piece is a skillful but fallacious example of “guilt by association”. If the colonialism article is wrong and objectionable the fault lies with a standard academic peer review. There is no connection here with the use of metrics etc and in my view the authors should withdraw this post.
. and come back with an evidence based critique of metrics – not as here one based on a single non-relevant anecdote.
Well your comment Patrick Dunleavy is wholly assertion and without substantiation in itself, and oblivious – determinedly so? – to the facts of the matter. The editor told the editorial board it was a peer reviewed piece. It was, but the reviewers had said the piece should be rejected. The editorial board has subsequently resigned, on the grounds that the requirements of peer review have been traduced.
Yesterday I checked out an article on a completely unrelated journal from the same publisher, for a UG reading list. Clicking on that papers page, I found the 3WQ piece commended with a live link as ‘other people are reading’. Undergraduates, for example, clicking on this would assume this was a legitimate piece of peer reviewed scholarship, and therefore not least factually correct, when this is really alt.right fake scholarship.
Patrick – It was a totally relevant critique on this blog, and Gilley withdrew his article yesterday. The evidence base was the errors and unsubstantiated work in the article.
In other coverage of the controversy over the Gilley piece, it has been reported that the article did not, in fact, pass peer review and the editor published it anyway. This is the reason why the majority of the editorial board resigned.
See:
https://www.insidehighered.com/news/2017/09/20/much-third-world-quarterlys-editorial-board-resigns-saying-controversial-article
http://www.chronicle.com/blogs/ticker/editorial-board-of-third-world-quarterly-resigns/120188
The authors disagree with the article but where is the actual rebuttal? When you respond by making a controversy yourself then I guess you have really taken the bait and are yourself just generating “hits.” I’ll wait for a carefully argued counter-argument.
A reading of the paper show errors of fact and terminology. You could check dates and timelines that show the impossibility of the claims made. You could investigate whether the sources cited actually substantiate the claims made. You could do the google thing and find the rebuttals out there, along with the resignation letter of the editorial board of the journal over the matter. But no, just going to wait. for someone to write a rebuttal.
Could you say more about the “many common metrics” used in academic today by which this paper will be the most successful in the journal’s history? You imply that the Altmetric Attention Score is one of them, but are there others?
Third World Quarterly was a very good journal publishing some excellent work. I am afraid that by publishing Gilley’s racist junk, the editor has effectively killed the journal. A very serious error of judgement by him.
Good piece on a worrying consequence of research impact. But tell us – do you think there’s benefit in the concept of research impact (as well as this sort of problem)? And what sort of research impact design might avoid the clickbait problem? Otherwise it’s pointing out a problem without even mentioning solutions, which is useful but incomplete.
It also seems like the ‘regulation’ mechanism worked quite well here after the publication – would’ve been better had it worked before, of course, but let’s not get carried away…
As a practitioner, I must note that a journal titled “Third World Quarterly” sounds like it needs to go the way of the term “Third World” anyway. We do not use that term anymore, and for good reason.
I think you may be missing the point.
Had Gilley’s artcle been published and subsequently ignored, or torn to shreds via critique of his analysis, it would have vanished in to obscurity.
Instead it has acheived fame not on account of any assumed intent to provoke, but from the absurd over reaction from the likes of Furhana Sultana and others, and their claims the item is “harmful”, “racist”, that Gilley is a supporter of “ethnic cleansing” and that people need protecting from such articles via censorship.
If you are seeing a problem here, try looking a bit closer to home for its resolution.
This is a genuinely ignorant comment. It was published in a peer reviewed journal. Except it wasn’t peer reviewed. It’s like a middle aged fat bloke like me playing football for England, and claiming my human rights are inforonged when it is pointed out I am not of the required standard.
I can play football in the park, and this guy can paste his alt right conspiracy theories on the web. No one is stopping that.
I have only read a copied version, but as I understand it was published in the equivalent of a “for comment” or “opinion” section in TWQ. It therefore has every right to be provocative, outrage (OMG! No!) and not necessarily hold to the usual standards of peer-review.
The (over)reaction to the article, which perfectly illustrates the ongoing criticism of tone and slant in humanities and social sciences academic discourse, and their relationships (possible irrelevance) to the outside world, has rightly caused the article to achieve the level of fame it wouldn’t have otherwise got near.
It is having impact precisely because the resulting reaction has caused its contents to transcend the niche debate it and TWQ inhabit. Gilley’s item has instead entered the broader arena, as evidence in discussions about “echo-chambers”, “academic-freedom”, abuse (“alt-right” and a “supporter of ethnic cleansing”….really?!) and attempted censorship for non-compliant views.
Moaning about the unfairness of its Altmetric Attention Score utterly misses where the article has led and to where the debate has moved.
As for your football analogy, I haven’t seen a word from Gilley on the issue. It is his critics who are complaining of infringements of rights and fairness and of harm being caused.
+1
This debacle says more about the insular state of academia than anything else. If the article is so bad, how about addressing its actual content rather than calling the author nasty names.
I’m recalling some famous LSE publications-slash-Daily Mail headlines…
Hakim, Catherine (2008) Is gender equality legislation becoming counter-productive? Public Policy Research, 15 (3). pp. 133-136. ISSN 1744-5396
Hakim, Catherine (2011) Erotic capital: the power of attraction in the boardroom and the bedroom. . Basic Books, New York, USA. ISBN 9780465027477
Kanazawa, Satoshi and Kovar, JL (2004) Why beautiful people are more intelligent. Intelligence, 32 (3). pp. 227-243
Kanazawa, Satoshi (2010) Why liberals and atheists are more intelligent. Social Psychology Quarterly, 73 (1). pp. 33-57. ISSN 0190-2725
etc
Bruce Gilley’s work is trash – but let’s not pretend that this august institution hasn’t played its part in hiring for impact, rewarding impact, and exacerbating this trend.
(Things only those of us outside the academy can say…)
Looks like it was peer reviewed after all. A lot of the arguments and displays of indignation on here need to be revised it seems. An actual rebuttal would be good in fact.
http://www.chronicle.com/blogs/ticker/journal-publisher-says-controversial-essay-did-pass-peer-review-process/120373
According to the publisher’s own account, the piece needed major revisions. A decision letter on this was sent to the author on 5th August. The revisions were done, with a covering letter, the paper was accepted, permissions and other admin were sorted, the paper was proof-read, corrected, typset, and published by 8th September.
Implausible. To say the least.
Further, major revisions mean that – a paper is very different indeed to the original. Accepting it without going back to the original reviewers mean the paper is not peer reviewed.
So, even according to the publishers, much
News came out yesterday that it was, in fact, peer reviewed.
Was Gilley just a sad devil’s advocate or a spreader of toxic contrarian views?
The (fortunate) rarity of articles like Gilley’s would have provoked profuse ironic curiosity (not necessarily support), which has boosted the metrics data. These data are evidently at risk of misinterpretation (unfortunate!).
To make the fiasco even more sickening, the editors allowed the piece is to be put behind a paywall, which could have added credibility to the metrics (in the opinion of some). And Taylor & Francis got some tainted money.
Utter nonsense. The reason the article got so much attention is that the authoritarian PC brigade (that’s you guys) made such a hysterical fuss about it.
Now the article has been withdrawn because threats of violence were made to the editor. Well done. The Streisand effect kicks in and the article gets lots more publicity.
It appears to me that the authors of this piece fall into the same “trap” as Gilley himself: make a few assertions that might be arguable (in Gilley’s case, that some examples of rule after colonialism were worse than the colonial government itself) and turn it into a completely fallacious argument: here, that any use metrics to evaluate scholarship is bad, that professors may be evaluated on their scholarship based on metrics, and thus scholarship is now the same as “clickbate.” That academia itself has been “hacked.” Metrics including altmetrics can be abused and manipulated, as can, and have been, traditional citations, and certainly one drawback of both is that these metrics do not distinguish between “positive” and “negative” commentary. Nevertheless having tools to measure, even imperfectly, the impact of articles can be a positive thing, and yes, scholars are sometimes measured by their impact as one component of their tenure and promotion process. I worry more about the increasing intolerance of alternative and controversial views, where increasingly scholarship is based not on its merits as scholarship (and, let’s be clear, Gilley’s “scholarship” in this case is staggeringly incompetent, which is why it’s not surprising that reports claim it did not pass peer review) but by if it offends someone. The Gilley piece should have never achieved publication in a peer-reviewed, academic journal, not because it is “clickbait” but because it is poor–horrendously poor–scholarship. Just as this piece belongs, as it is, on a blog, and does not rise to the merit of scholarship.