Research impact is often equated with the way in which research articles are cited and used by other researchers and non-academics. An often less appreciated aspect of research impact is the impact that the ideas contained within research papers and books have when used to teach students. In this re-post Anne-Wil Harzing presents the The Open Syllabus Explorer, an online tool […]
India’s retrospective review of PhD research quality is set to significantly change research practices
India’s University Grants Commission recently invited proposals to retrospectively assess the quality of PhD theses awarded by the country’s universities over the past 10 years. In this post Santosh C. Hulagabali, outlines the potential impacts of this review on Indian universities and scholars and highlights the role of this review in signaling the quality of Indian research.
In the […]
Grant capture, or the ability of researchers to secure funding for their projects, is often used as a formal metric for academic evaluation. In this repost, Dorothy Bishop argues that this practice has led to peverse incentives for researchers and institutions and that research funders have both a responsibility and a significant interest in using their influence to halt […]
Developing a finer grained analysis of research impact: Can we assess the wider effects of public engagement?
Promoting public engagement with research has become a core mission for research funders. However, the extent to which researchers can assess the impact of this engagement is often under-analysed and limited to success stories. Drawing on the example of development aid, Marco J Haenssgen argues we need to widen the parameters for assessing public engagement and begin to develop […]
Academic review promotion and tenure documents promote a view of open access that is at odds with the wider academic community
A critical issue for advocates of Open Access (OA) has been the persistent lack of institutional incentives for academics to engage with Open Access publishing. Drawing on their research into Review, Promotion and Tenure documents, a team at the Scholarly Communications Lab, including Juan Pablo Alperin, Esteban Morales and Erin McKiernan argue that when these key documents for research […]
As previous posts on the Impact Blog have highlighted, one aspect of the impact agenda that has until recently been relatively neglected has been that of negative impact, or ‘grimpact’. In this post Valeria Izzi and Becky Murray draw on examples from development practice and research to advance a more complex understanding of grimpact and argue that as development […]
The applicability of Randomised Control Trials (RCTs) to the social sciences has been widely questioned. However, assessing the effectiveness of RCTs, in practice has proved difficult. In this post, Naila Kabeer reflects on her recent research into randomised control trials utilised as part of a programme to alleviate poverty in West Bengal and highlights how, when RCTs are used […]
A critical blind spot in the impact agenda has been that impact is understood and defined solely in positive terms. In this post Gemma Derrick and Paul Benneworth introduce the concept of ‘Grimpact’, to describe instances where research negatively impacts society, and argue that the implicit optimism of research assessment has rendered researchers and science systems poorly equipped to […]
Charting the rise and fall of North American leadership in global science: Insights from the population of Nobel Laureates.
For the majority of the last century North America has been at the epicentre of global scientific research. However, through the course of the 21st century other countries have begun to close this gap in a number of ways, notably China is now the global leader in published research and is on course to overtake the US in […]
The UK research system has historically been innovative in its approach to measuring and assessing the impacts of academic research. However, the recent development of the Knowledge Exchange Framework (KEF), has elicited scepticism as to how this framework will significantly differ from the impact element of the Research Excellence Framework (REF). In this post Hamish McAlpine and Steven […]
The impact agenda is an international and evolutionary phenomenon that has undergone numerous iterations. Discussing the development and recent release of the results of the Australian Engagement and Impact Assessment (EIA), Ksenia Sawczak considers the effectiveness of this latest exercise in impact assessment, finding it to provide an inadequate account of the impact of Australian research and ultimately a shaky […]
The UN Sustainable Development Goals (SDGs) represent one of the largest and most sustained influences on global research to date. However, charting the effect of these 17 goals on the global research community is a complex task. In this post, Martin Szomszor draws on the findings of a recent bibliometric study to produce a ‘citation map’ of sustainability research, […]
Societal impact has become the hallmark of high quality research, as is reflected in the decision to make impact worth 25% of REF 2021 assessments and the introduction of Research Missions into the Horizon Europe framework. However, the ability to produce societal impacts is often linked to career stage and job stability. Reporting on a survey of Early Career […]
Preprints – rapidly published non peer reviewed research articles – are becoming an increasingly common fixture in scholarly communication. However, without being peer reviewed they serve a limited function, as they are often not recognised as high quality research publications. In this post Wang LingFeng discusses how the development of preprint servers as self-organising peer review platforms could be the future […]
Altmetrics have become an increasingly ubiquitous part of scholarly communication, although the value they indicate is contested. In this post, Lutz Bornmann and Robin Haunschild present evidence from their recent study examining the relationship of peer review, altmetrics, and bibliometric analyses with societal and academic impact. Drawing on evidence from REF2014 submissions, they argue altmetrics may provide evidence for […]
The potential impacts of Plan S (a funder led plan to accelerate a global flip to open access to research publications) on the wider research ecosystem are only beginning to be understood. Citing evidence from a recent report by the Institute for Scientific Information on Plan S funded research papers, Dr Martin Szomszor, outlines what the impact of the plan […]
Third mission accomplished? Why are universities bad at engaging with local and regional government and what we can do about it.
Universities are increasingly called upon to engage with local and regional government, namely as part of a ‘third academic mission’, but how effectively do they incentivize academics to do so? Using evidence from her study of the University of Aveiro, Liliana Fonseca explores the barriers that hinder engagement with these institutions and makes recommendations for how universities could expand […]
Between value for money & development impact: Some reflections for the Global Challenges Research Fund
The Global Challenges Research Fund has engaged many researches with Official Development Assistance and the auditing and assessment infrastructures associated with it. In this post Valeria Izzi and Becky Murray outline how researchers can adopt a value for money (VfM) approach that can justify North/South research projects in a way that accounts for economy, efficiency, effectiveness, as well as […]
A vital part of any research assessment program is the ability to clearly demonstrate the impacts, whatever they may, of the research undertaken. In this post, Katy McEwan presents the impact chain approach for writing impact case studies. A method, which provides a framework for producing impact narratives and helps authors clearly describe and spotlight the consequences, intended and […]