• Permalink Gallery

    Despite becoming increasing institutionalised, there remains a lack of discourse about research metrics among much of academia

Despite becoming increasing institutionalised, there remains a lack of discourse about research metrics among much of academia

The active use of metrics in everyday research activities suggests academics have accepted them as standards of evaluation, that they are “thinking with indicators”. Yet when asked, many academics profess concern about the limitations of evaluative metrics and the extent of their use. Why is there such a discrepancy between principle and practices pertaining to metrics? Lai Ma suggests […]

Print Friendly
  • Permalink Gallery

    Beyond #FakeScience: how to overcome shallow certainty in scholarly communication

Beyond #FakeScience: how to overcome shallow certainty in scholarly communication

Recent media reports in Germany have brought renewed focus on predatory publishing practices and seen a notably increased use of the term “fake science”. But to what extent is this a worsening problem? Lambert Heller argues that predatory publishing has never really become a big thing, and that it became a thing at all is largely attributable to the simple […]

Print Friendly
  • Permalink Gallery

    There is an absence of scientific authority over research assessment as a professional practice, leaving a gap that has been filled by database providers

There is an absence of scientific authority over research assessment as a professional practice, leaving a gap that has been filled by database providers

Research metrics have become more established as a means to assess research performance. This is understandable given research institutions’ and funders’ demand for assessment techniques that are relatively cheap and universally applicable, even though use of such metrics remains strongly contested within scientific communities. But to what extent does the academic research field of evaluative citation analysis confer legitimacy […]

Print Friendly
  • Permalink Gallery

    Playing the game: academics have bought into the competition and become complicit in their exploitation

Playing the game: academics have bought into the competition and become complicit in their exploitation

The managerialist logic that has permeated universities has had a clear impact on academic work. To Senia Kalfa, Adrian Wilkinson and Paul J. Gollan, academia has become like a game, with academics competing with each other for just a handful of permanent positions and focused completely on accumulating the capital (publications, grant income, etc.) needed to secure one. Rather […]

Print Friendly
  • Permalink Gallery

    Making research evaluation processes in Europe more transparent

Making research evaluation processes in Europe more transparent

Researchers repeatedly cite career advancement as a key incentive for their practices and behaviours. This is critical to understanding the pace of change in scholarly communications, as those researchers inclined to innovate or experiment with new forms of research outputs, methodologies, or communication styles risk being penalised by the evaluation system used by many research institutions that are slow […]

Print Friendly
  • Permalink Gallery

    How to compare apples with oranges: using interdisciplinary “exchange rates” to evaluate publications across disciplines

How to compare apples with oranges: using interdisciplinary “exchange rates” to evaluate publications across disciplines

Academic research performance is typically assessed on the basis of scientific productivity. While the number of publications may provide an accurate and useful metric of research performance within one discipline, interdisciplinary comparisons of publication counts prove much more problematic. To solve this problem, Timo Korkeamäki, Jukka Sihvonen, and Sami Vähämaa introduce interdisciplinary “exchange rates”, which can be used to […]

Print Friendly
  • Permalink Gallery

    Making visible the impact of researchers working in languages other than English: developing the PLOTE index

Making visible the impact of researchers working in languages other than English: developing the PLOTE index

As outlined in the Leiden Manifesto, if impact is understood in terms of citations to international publications, a bias is created against research which is regionally focused and engaged with local society problems. This is particularly critical for researchers working in contexts with languages other than English. Peter Dahler-Larsen has developed the PLOTE index, a new indicator which hopes […]

Print Friendly
  • Permalink Gallery

    Six principles for assessing scientists for hiring, promotion, and tenure

Six principles for assessing scientists for hiring, promotion, and tenure

The negative consequences of relying too heavily on metrics to assess research quality are well known, potentially fostering practices harmful to scientific research such as p-hacking, salami science, or selective reporting. The “flourish or perish” culture defined by these metrics in turn drives the system of career advancement in academia, a system that empirical evidence has shown to be […]

Print Friendly
  • Permalink Gallery

    For China to realise its research and innovation potential the government may have to place greater trust in the academic community

For China to realise its research and innovation potential the government may have to place greater trust in the academic community

After three decades of being the world’s manufacturing powerhouse, China is now looking to science and technology to drive its economic future. However, a recent study suggests that China’s higher education research environment faces numerous challenges that may hinder the country from realising its research and innovation potential; from the promotion of short-term thinking, to an excessive level of […]

Print Friendly
  • Permalink Gallery

    Your research has been broadcast to millions – but how do you determine its impact?

Your research has been broadcast to millions – but how do you determine its impact?

The potential of broadcast programming to reach millions of people holds obvious appeal to researchers looking to maximise the dissemination of their work. But when it comes to impact, having vast reach is just one part of the equation – how can the significance of broadcast research be determined? Melissa Grant, Lucy Vernall and Kirsty Hill developed a mixed-methods […]

Print Friendly
  • Permalink Gallery

    Book Review: Publish or Perish: Perceived Benefits versus Unintended Consequences by Imad A. Moosa

Book Review: Publish or Perish: Perceived Benefits versus Unintended Consequences by Imad A. Moosa

Academics today have to publish to succeed. In Publish or Perish: Perceived Benefits versus Unintended Consequences, Imad A. Moosa assesses the disastrous consequences of this view for academics, both personally and academically. Review by James Hartley.

This review originally appeared on LSE Review of Books and is published under a CC BY-NC-ND 2.0 UK license.

Publish or Perish: Perceived Benefits Versus Unintended Consequences. Imad A. […]

Print Friendly
  • Permalink Gallery

    The role of the self in the research process: reflections on researching the REF as a PhD student

The role of the self in the research process: reflections on researching the REF as a PhD student

In this short, reflective post, Emily Yarrow considers her experiences as a PhD student researching women’s lived experiences of research evaluation in the UK and particularly the anxieties she felt as a junior researcher interviewing very senior, esteemed academic colleagues. It is important to reflect on the role researchers play in the interviewing and data collection process, and also […]

Print Friendly
  • Permalink Gallery

    A brief history of research impact: how has impact assessment evolved in the UK and Australia?

A brief history of research impact: how has impact assessment evolved in the UK and Australia?

Over the last couple of decades there has been an international push around the assessment of the wider societal impact of research. Kate Williams and Jonathan Grant document the evolution of research impact assessment in the UK and Australia, and how policies in the two countries have been seemingly interdependent, a back-and-forth process developed through international learning. Continued political […]

Print Friendly
  • Permalink Gallery

    Looming REF deadlines lead to a rush in publication of lower quality research

Looming REF deadlines lead to a rush in publication of lower quality research

The increased significance of research assessments and their implications for funding and career prospects has had a knock-on effect on academic publication patterns. Moqi Groen-Xu, Pedro A. Teixeira, Thomas Voigt and Bernhard Knapp report on research that reveals a marked increase in research productivity immediately prior to an evaluation deadline, which quickly reverses once the deadline has passed. Moreoever, […]

Print Friendly
  • Permalink Gallery

    Hitting the QR sweet spot: will new REF2021 rules lead to a different kind of game-playing?

Hitting the QR sweet spot: will new REF2021 rules lead to a different kind of game-playing?

Today marks 999 days until the expected deadline for submissions to REF 2021. Universities’ preparations are already well under way, with additional guidance published last autumn in the form of new REF rules designed to reduce game-playing behaviours among institutions. However, as Simon Kerridge observes, the rule changes may have introduced, or rather enhanced, some hidden dangers around universities’ […]

Print Friendly
  • Permalink Gallery

    Beyond Impact Factors: an Academy of Management report on measuring scholarly impact

Beyond Impact Factors: an Academy of Management report on measuring scholarly impact

What constitutes scholarly impact? And which stakeholders have importance for research? Usha Haley shares findings of a recent Academy of Management report that sought answers to these questions by surveying its 20,000 members and conducting a selection of in-depth interviews with prominent figures. A majority of respondents indicated journal rankings did not reflect scholarly impact, yet publications in top-tier […]

Print Friendly
  • Permalink Gallery

    Resist? Welcome? Co-opt? Ignore? The pressures and possibilities of the REF and impact

Resist? Welcome? Co-opt? Ignore? The pressures and possibilities of the REF and impact

The increased focus on impact in research evaluation represents a range of possibilities and pressures to those academics whose work is being assessed. For some it offers an opportunity to progress social justice causes and engage in participatory, bottom-up research approaches with less powerful groups; while to others it is further evidence of the managerial audit culture that is […]

Print Friendly
  • Permalink Gallery

    Where are we with responsible metrics? And where might we go next? Reflections from two recent events

Where are we with responsible metrics? And where might we go next? Reflections from two recent events

Widespread scepticism and concern among researchers, universities, representative bodies and learned societies about the broader use of metrics in research assessment and management has led to concerted efforts to promote the “responsible use” of such metrics. But how effectively are UK higher education institutions engaging with this agenda? Lizzie Gadd reflects on two recent responsible metrics-themed events. While it […]

Print Friendly
  • Permalink Gallery

    From invisibility to impact: radically different measures are needed to capture the true impact of research

From invisibility to impact: radically different measures are needed to capture the true impact of research

Academics are increasingly expected to produce directly applicable solutions to hard-to-solve “real-world” problems such as poverty, development, and environmental degradation. However, conventional assessments of science have not yet been adequately adapted to capture the diverse effects of this type of problem-centred research. Examining a prominent recent example of multidisciplinary research on consumption, environment and sustainability in Ireland, Henrike Rau, […]

Print Friendly
This work by LSE Impact of Social Sciences blog is licensed under a Creative Commons Attribution 3.0 Unported.