LSE - Small Logo
LSE - Small Logo

Andrea Padilla

September 17th, 2024

The value of REF beyond academia – From research to development impact

0 comments | 9 shares

Estimated reading time: 7 minutes

Andrea Padilla

September 17th, 2024

The value of REF beyond academia – From research to development impact

0 comments | 9 shares

Estimated reading time: 7 minutes

The Research Excellence Framework is primarily a mechanism for assessing the quality of research and allocating research funding. However, as Andrea Padilla describes in the context of UK international development, REF outputs and in particularly impact case studies hold value for many actors outside of higher education institutions.


The Research Excellence Framework (REF) plays a crucial role in assessing the quality, impact, and environment of UK research. While it is primarily used within academia for accountability, funding allocation, and benchmarking, the REF’s value extends far beyond these purposes. For those outside academia, it provides a unique opportunity to highlight the real-world societal impacts of UK research.

This is particularly the case for organisations like ours, the UK Collaborative on Development Research (UKCDR), as we found in our recent analysis of REF 2021 Impact Case Studies (ICS). Although significant effort goes into preparing and assessing REF submissions, once the results are out, most Higher Education Institutions and researchers focus on their achievements and start preparing for the next cycle. However, the broader applications of REF’s data, especially in examining the societal benefits of research, are often overlooked.

Organisations like RAND, the British Academy, and UKCDR have taken advantage of REF’s data to explore the real-life impact of UK research.

Organisations like RAND, the British Academy, and UKCDR have taken advantage of REF’s data to explore the real-life impact of UK research. At UKCDR, we found that REF offers an invaluable resource for analysing how UK Higher Education Institutions’ research contributes to solving global challenges, such as climate change, inequality and poverty, particularly in low- and middle-income countries (LMICs). The REF 2021 ICS dataset not only strengthens the case for the transformative power of international development research, but also highlights how UK funders can effectively support impactful research.

A valuable data repository

The depth and open-access nature of REF 2021 data enabled UKCDR to identify 891 international development-related case studies. These were defined as “research that addresses global challenges, in alignment with SDGs, and results in political, economic, social, health or environmental change for the benefit of LMICs, specific regions, and/or the global community.”

Our report, The Landscape of UK Development Research Impact, analysed the non-academic impact of international development research undertaken by UK HEIs between 2013 and 2020, revealing important trends and gaps alongside links between real-life outcomes (what type of impact was achieved) and research practices (how research was conducted).

By categorising ICS based on SDG alignment, geographical impact, partnerships, research users, and funding sources, we gained an overview of development-related research across REF panels and disciplines. We also created a research impact data tool to visualise our analysis, offering an interactive way to explore these categories by REF panels, Units of Assessment (UoAs), and Higher Education Institutions (HEIs).

Insights from REF on development impact

One surprising finding was that international development research occurs across all four REF 2021 panels and all 32 UoAs, including disciplines not traditionally associated with development, such as mathematics and philosophy. Less surprisingly, (for the case studies that included funding data) we found that they were predominantly funded by UK public funds, with 37% coming from Official Development Assistance (ODA) and 63% from non-ODA sources.

One surprising finding was that international development research occurs across all four REF 2021 panels and all 32 UoAs

The ICS demonstrated UK research’s contribution to development across all SDGs, tackling issues from environmental matters like peatland management to improving healthcare practices. The most frequent addressed SDGs were Health and Wellbeing (SDG 3) and Peace, Justice, and Strong Institutions (SDG 16). Geographically, impact was concentrated in India, Kenya, South Africa, Brazil, and Uganda. Through this and other findings, REF data enabled a wider understanding of the UK’s development research and funding landscape.

Evidencing real-world impact

We also used the impact summary and details sections within REF ICS to further explore the real-life impact achieved by UK HEIs. We identified four broad categories and subcategories of development impact:

Most case studies in our study demonstrated multiple types of impact throughout their research cycle. For instance, the University of Northampton’s case study on 3D model-based ultrasonic testing for metal casting led to reduced waste, faster inspections, and cost savings for 17 Indian companies (instrumental impact). Additionally, the research fostered a new training programme for foundry technicians, contributing to long-term skills development (learning and development impact). It also forged partnerships with Indian institutions, further strengthening research and industrial collaboration (networks and connectivity impact).

Leveraging REF for best practices

As we mapped the case studies and gained interesting insights on the types of impact, we moved into exploring the research processes. We chose 10 REF case studies from across UoAs and interviewed both the research teams and end-users to gather their views on the challenges and opportunities in achieving impactful research. As a result, we identified a series of best practices compiled in a new research enablers framework. Centred on flexibility and collaboration, the UKCDR framework outlines six dimensions to support real-life impact throughout the research cycle.

But what kind of case studies featured in UKCDR’s analysis? One of the case studies that we analysed in Realising the Impact of UK International Development Research was submitted by the Royal Veterinary College on addressing schistosomiasis, a neglected tropical disease, using a ‘One Health’ approach. The case study demonstrated the value of taking advantage of various funding approaches and finding alternatives to overcome operational issues. The team used small grants to integrate veterinary and social sciences, highlighting sociocultural factors in disease transmission. Additionally, they explored alternative operational and financial routes to balance contracting requirements with local partners’ capacities and on-the ground realities. This enabled rapid fieldwork implementation, adapting to unforeseen circumstances. This is just one example from the broad range of projects that contribute to international development goals.

Strengthening research for development

Maximising the value of REF is not without its challenges. The submissions are designed for evaluation, not analysis, and the completeness of data varies. However, the publicly available REF database provides a useful resource for understanding (and underscoring) the breath and success of UK research in advancing international development. For research funders, the trends and gaps revealed by the mapping constitute a valuable tool for evidence-based policymaking, thus enhancing the overall effectiveness of the research funding landscape.

The types of impact, best practices and enablers identified through our analysis of REF impact case studies offer ways to enhance the impact of research, informing the overall research community for more coherent and effective outcomes. This contributes to the development of an evidence-based, interdisciplinary and transdisciplinary research ecosystem, crucial for tackling global challenges.

 


The content generated on this blog is for information purposes only. This Article gives the views and opinions of the authors and does not reflect the views and opinions of the Impact of Social Science blog (the blog), nor of the London School of Economics and Political Science. Please review our comments policy if you have any concerns on posting a comment below.

Image Credit: Alphavector on Shutterstock


Print Friendly, PDF & Email

About the author

Andrea Padilla

Andrea Padilla is a Research and Policy Officer at UKCDR. Her role involves providing UK research funders with evidence-based data and best practices to promote coherence, collaboration and joint action among them. Her interests include research impact, innovation policy, research evaluation and funding.

Posted In: Impact | REF2021 | REF2029 | Research evaluation

Leave a Reply

Your email address will not be published. Required fields are marked *