• OLYMPUS DIGITAL CAMERA
    Permalink OLYMPUS DIGITAL CAMERAGallery

    What impact evidence was used in REF 2014? Disciplinary differences in how researchers demonstrate and assess impact

What impact evidence was used in REF 2014? Disciplinary differences in how researchers demonstrate and assess impact

A new report produced by the Digital Science team explores the types of evidence used to demonstrate impact in REF2014 and pulls together guidance from leading professionals on good practice. Here Tamar Loach and Martin Szomszor present a broad look at the the types of evidence in use in the REF impact case studies and reflect on the association between use of […]

Print Friendly
  • Risk_and_Control_Impact_Assessment
    Permalink Gallery

    Evaluating research assessment: Metrics-based analysis exposes implicit bias in REF2014 results.

Evaluating research assessment: Metrics-based analysis exposes implicit bias in REF2014 results.

The recent UK research assessment exercise, REF2014, attempted to be as fair and transparent as possible. However, Alan Dix, a member of the computing sub-panel, reports how a post-hoc analysis of public domain REF data reveals substantial implicit and emergent bias in terms of discipline sub-areas (theoretical vs applied), institutions (Russell Group vs post-1992), and gender. While metrics are […]

Print Friendly
  • big ben clock
    Permalink Gallery

    The impact of academia on Parliament: 45 percent of Parliament-focused impact case studies were from social sciences

The impact of academia on Parliament: 45 percent of Parliament-focused impact case studies were from social sciences

How does academic research feed into the parliamentary process? Analysing the impact case studies of the 2014 REF, Caroline Kenny draws out potential lessons on how Parliament is currently engaging with academics, and how it might in the future. Impact case studies referring to Parliament were found in all four of the main subject panels, but 45 per cent […]

Print Friendly
  • Jo_Johnson_at_British_Museum
    Permalink Gallery

    Five reasons the Teaching Excellence Framework is bad news for higher education

Five reasons the Teaching Excellence Framework is bad news for higher education

Jessica Patterson argues the announcement of proposals for a Teaching Excellence Framework (TEF) is bad news indeed for those concerned about a more rapid pace to the marketisation of higher education. Here she outlines five key concerns against a teaching assessment framework given the wider context of greater casualisation and stratification in the workforce and a ‘value for money’ approach […]

Print Friendly
  • 6392-success-formula
    Permalink Gallery

    Women’s working lives in the managerial university and the pernicious effects of the ‘normal’ academic career.

Women’s working lives in the managerial university and the pernicious effects of the ‘normal’ academic career.

University faculties need to be able to demonstrate to young people, male and female, that women can be just as inspiring teachers and researchers, and be able to live as enjoyable a domestic life as their male counterparts. Angela McRobbie reflects on how the ideal career track in the academy, suffused with constant benchmarking around ‘excellence’ and the REF’s logic […]

Print Friendly
  • ResearchIncome2featured
    Permalink Gallery

    Was the REF a waste of time? Strong relationship between grant income and quality-related funding allocation.

Was the REF a waste of time? Strong relationship between grant income and quality-related funding allocation.

If the funding allocated to universities on the basis of the REF is correlated to the amount of grant income universities already receive, what is the point of the output assessment process? Jon Clayden explores the relationship between grant income generated and REF-related QR funding and finds a strong correlation between the two, suggesting that the double-counting exercise is surely not the best we […]

Print Friendly
  • calculator
    Permalink Gallery

    Why did REF2014 cost three times as much as the RAE? Hint: It’s not just because of the added impact element.

Why did REF2014 cost three times as much as the RAE? Hint: It’s not just because of the added impact element.

The benefits of any research assessment framework should ideally outweigh the costs and burden incurred by universities and staff. Derek Sayer argues there should be cause for concern now that recent analysis shows the 2014 REF bill was three times as much as the last UK assessment exercise. The costly increase in staff time was driven by the increased importance […]

Print Friendly
  • featured fig 1 impact metric tracking
    Permalink Gallery

    Rather than narrow our definition of impact, we should use metrics to explore richness and diversity of outcomes.

Rather than narrow our definition of impact, we should use metrics to explore richness and diversity of outcomes.

Impact is multi-dimensional, the routes by which impact occur are different across disciplines and sectors, and impact changes over time. Jane Tinkler argues that if institutions like HEFCE specify a narrow set of impact metrics, more harm than good would come to universities forced to limit their understanding of how research is making a difference. But qualitative and quantitative indicators continue […]

Print Friendly
  • orcid id featured
    Permalink Gallery

    The Management of Metrics: Globally agreed, unique identifiers for academic staff are a step in the right direction.

The Management of Metrics: Globally agreed, unique identifiers for academic staff are a step in the right direction.

The Metric Tide report calls for research managers and administrators to champion the use of responsible metrics within their institutions. Simon Kerridge looks at greater detail at specific institutional actions. Signing up to initiatives such as the San Francisco Declaration on Research Assessment (DORA) is a good start. Furthermore, by mandating unique and disambiguated identifiers for academic staff, like ORCID iDs, […]

Print Friendly

Book Review: Sexuality: A Psychosocial Manifesto

Author Katherine Johnson argues for a psychosocial approach that rethinks the relationship between psychic and social realms in the field of sexuality, without reducing it to either. Weaving through an expanse of theoretical and empirical examples drawn from sociology, psychology, queer and cultural studies, she produces an innovative, transdisciplinary perspective on sexual identities, subjectivities and politics. Alexander Blanchard argues […]

Print Friendly
  • worldmap
    Permalink Gallery

    Influential, international and interdisciplinary: The impact of the UK’s research.

Influential, international and interdisciplinary: The impact of the UK’s research.

The Policy Institute at King’s College London, along with colleagues in the digital humanities department, teamed up with technology company Digital Science to build a searchable database and produce a rich analysis of the impact case studies for the 2014 Research Excellence Framework. Saba Hinrichs and Jonathan Grant introduce the key findings of the analysis and explain how the resource […]

Print Friendly
  • divine ascent
    Permalink Gallery

    Book Review: Rank Hypocrisies: the Insult of the REF by Derek Sayer.

Book Review: Rank Hypocrisies: the Insult of the REF by Derek Sayer.

Publication of the results of the 2014 Research Excellence Framework evaluation of the quality of work undertaken in all UK universities last December attracted much attention, as league tables of university and department standings were constructed and estimates of the financial consequences of the achieved grades were assessed. Soon after that, a book was published savagely criticising the peer […]

Print Friendly
  • 3348184808_a6c4d1d89e_b
    Permalink Gallery

    Impact doesn’t have to be a dirty word – staying positive about the promotion of scientific excellence.

Impact doesn’t have to be a dirty word – staying positive about the promotion of scientific excellence.

The research funding landscape looks bleak in many areas at present, but that’s all the more reason to focus on success stories, argues Ben McCluskey. Universities are doing great work to bring jobs and money into the regions they serve, but they should be supported by a framework based on national cooperation, not competition.

In light of the incredible research […]

Print Friendly
  • higher ed
    Permalink Gallery

    Governing through unhappiness: Audit culture and the lasting effects of the REF.

Governing through unhappiness: Audit culture and the lasting effects of the REF.

After the REF dust settled on 2014, what will come next for the higher education sector? Will Davies breaks down audit culture and describes neoliberalism as the ‘disenchantment of politics by economics’ where processes traditionally left in the realm of politics must now be reconfigured in calculative, economically rational terms. When audit becomes married to rapidly shrinking budgets, and […]

Print Friendly
  • Anti-capitalism_color
    Permalink Gallery

    Against REFonomics: Quantification cannot satisfy the demands of rationality, equity and tolerability.

Against REFonomics: Quantification cannot satisfy the demands of rationality, equity and tolerability.

Academics are assured by government ministers and institutional heads that research assessment is designed on their behalf. Liz Morrish looks at whether the assessment tools created have extended their reach and left academics exposed. At its best, the REF distorts research agendas and priorities. However, a graver hazard is that a new selective and competitive academic will be formed, whose […]

Print Friendly
  • casestudiesthemes featured image
    Permalink Gallery

    In the wake of the REF, LSE launches impact website to demonstrate how research can make a difference.

In the wake of the REF, LSE launches impact website to demonstrate how research can make a difference.

Love it or loathe it, impact is fast becoming the buzz word in UK academia.  To coincide with the release of the REF2014 results on 18 December 2014, which will demonstrate how well (or otherwise) UK academia is creating impact from its research beyond the academy, LSE is joining the growing number of UK higher education institutions to showcase […]

Print Friendly
  • assessment columns
    Permalink Gallery

    Time for REFlection: HEFCE look ahead to provide rounded evaluation of the REF.

Time for REFlection: HEFCE look ahead to provide rounded evaluation of the REF.

Head of Research Policy at the Higher Education Funding Council for England, Steven Hill, presents an overview of the work HEFCE are currently commissioning which they are hoping will build a robust evidence base for research assessment. He argues that attention on the costs, benefits, problems and solutions of the REF are an obvious starting point, but it is also important that the […]

Print Friendly
  • competition
    Permalink Gallery

    Predicting the results of the REF using departmental h-index: A look at biology, chemistry, physics, and sociology.

Predicting the results of the REF using departmental h-index: A look at biology, chemistry, physics, and sociology.

Can metrics be used instead of peer review for REF-type assessments? With the stakes so high, any replacement would have to be extremely accurate. Olesya Mryglod, Ralph Kenna, Yurij Holovatch and Bertrand Berche looked at two metric candidates, including the departmental h-index, and four subject areas: biology, chemistry, physics and sociology. The correlations are significant, but comparisons with RAE indicate that […]

Print Friendly
  • healthcare
    Permalink Gallery

    Collaborative ‘science of science’ needed to ensure research and education make a difference to practice.

Collaborative ‘science of science’ needed to ensure research and education make a difference to practice.

Zoë Sheppard, Vanora Hundley, Edwin van Teijlingen and Paul Thompson of Bournemouth University present the challenges of impact in healthcare recently discussed at a symposium held by the Centre of Postgraduate Medical Research and Education at Bournemouth University. Given the imminent results of the Research Excellence Framework 2014, the summarised findings and issues raised on the implementation of impact point to further collaborations needed on […]

Print Friendly
December 15th, 2014|Government, Impact, REF 2014|1 Comment|
This work by LSE Impact of Social Sciences blog is licensed under a Creative Commons Attribution 3.0 Unported.