• Risk_and_Control_Impact_Assessment
    Permalink Gallery

    Evaluating research assessment: Metrics-based analysis exposes implicit bias in REF2014 results.

Evaluating research assessment: Metrics-based analysis exposes implicit bias in REF2014 results.

The recent UK research assessment exercise, REF2014, attempted to be as fair and transparent as possible. However, Alan Dix, a member of the computing sub-panel, reports how a post-hoc analysis of public domain REF data reveals substantial implicit and emergent bias in terms of discipline sub-areas (theoretical vs applied), institutions (Russell Group vs post-1992), and gender. While metrics are […]

Print Friendly
  • juggling
    Permalink Gallery

    Accounting for Impact? How the Impact Factor is shaping research and what this means for knowledge production.

Accounting for Impact? How the Impact Factor is shaping research and what this means for knowledge production.

Why does the impact factor continue to play such a consequential role in academia? Alex Rushforth and Sarah de Rijcke look at how considerations of the metric enter in from early stages of research planning to the later stages of publication. Even with initiatives against the use of impact factors, scientists themselves will likely err on the side of caution and continue […]

Print Friendly
  • eco belfast
    Permalink Gallery

    The role of ego in academic profile services: Comparing Google Scholar, ResearchGate, Mendeley, and ResearcherID

The role of ego in academic profile services: Comparing Google Scholar, ResearchGate, Mendeley, and ResearcherID

Academic profiling services are a pervasive feature of scholarly life. Alberto Martín-Martín, Enrique Orduna-Malea and Emilio Delgado López-Cózar discuss the advantages and disadvantages of major profile platforms and look at the role of ego in how these services are built and used. Scholars validate these services by using them and should be aware that the portraits shown in these platforms depend to a great […]

Print Friendly
  • parasite
    Permalink Gallery

    Credit where credit is due: Research parasites and tackling misconceptions about academic data sharing

Credit where credit is due: Research parasites and tackling misconceptions about academic data sharing

Benedikt Fecher and Gert G. Wagner look at a recent editorial which faced considerable criticism for typecasting researchers who use or build on previous datasets as “research parasites”. They argue that the authors appear to miss the point, not only of data sharing, but of scientific research more broadly. But as problematic as the editorial may be, it points to […]

Print Friendly
  • dark matter global
    Permalink Gallery

    A call for inclusive indicators that explore research activities in “peripheral” topics and developing countries.

A call for inclusive indicators that explore research activities in “peripheral” topics and developing countries.

Science and Technology (S&T) systems all over the world are routinely monitored and assessed with indicators that were created to measure the natural sciences in developed countries. Ismael Ràfols and Jordi Molas-Gallart argue these indicators are often inappropriate in other contexts. They urge S&T analysts to create data and indicators that better reflect research activities and contributions in these “peripheral” […]

Print Friendly
  • dna sequence
    Permalink Gallery

    It’s time to put our impact data to work to get a better understanding of the value, use and re-use of research.

It’s time to put our impact data to work to get a better understanding of the value, use and re-use of research.

If published articles and research data are subject to open access and sharing mandates, why not also the data on impact-related activity of research outputs? Liz Allen argues that the curation of an open ‘impact genome project’ could go a long way in remedying our limited understanding of impact. Of course there would be lots of variants in the type of impact […]

Print Friendly
  • Cornelis_Brizé_-_Treasurers'_papers_and_documents_-_Google_Art_Project
    Permalink Gallery

    Policy impact and online attention: Tracking the path from research to public policy on the social web.

Policy impact and online attention: Tracking the path from research to public policy on the social web.

The process by which research gets put into action is far from clear cut, argues Stacy Konkiel. Extracting references to research from policy documents is a step towards illuminating the murky path. But we should be careful not to disregard other forms of evidence like online and media mentions as they are closely interrelated and may even lead to quicker impacts […]

Print Friendly
  • machine dials
    Permalink Gallery

    Context is everything: Making the case for more nuanced citation impact measures.

Context is everything: Making the case for more nuanced citation impact measures.

Access to more and more publication and citation data offers the potential for more powerful impact measures than traditional bibliometrics. Accounting for more of the context in the relationship between the citing and cited publications could provide more subtle and nuanced impact measurement. Ryan Whalen looks at the different ways that scientific content are related, and how these relationships could be […]

Print Friendly
  • programming-942487_640
    Permalink Gallery

    Why we need a hub for software in science: Research software developers deserve wider academic recognition.

Why we need a hub for software in science: Research software developers deserve wider academic recognition.

Jure Triglav looks at how software recognition, credit and discovery is a massive problem facing the scientific community. Though instrumental to scientific innovation, software creation and maintenance is rarely recognised. By building a hub for research software, scientists could shine a spotlight on its developers and show the extent, importance and impact of their work. Enter Depsy – a new research […]

Print Friendly

The ResearchGate Score: a good example of a bad metric

According to ResearchGate, the academic social networking site, their RG Score is “a new way to measure your scientific reputation”. With such high aims, Peter Kraker, Katy Jordan and Elisabeth Lex take a closer look at the opaque metric. By reverse engineering the score, they find that a significant weight is linked to ‘impact points’ – a similar metric to the […]

Print Friendly
  • oxford
    Permalink Gallery

    Bringing together bibliometrics research from different disciplines – what can we learn from each other?

Bringing together bibliometrics research from different disciplines – what can we learn from each other?

Currently, there is little exchange between the different communities interested in the domain of bibliometrics. A recent conference aimed to bridge this gap. Peter Kraker, Katrin Weller, Isabella Peters and Elisabeth Lex report on the multitude of topics and viewpoints covered on the quantitative analysis of scientific research. A key theme was the strong need for more openness and transparency: transparency in research […]

Print Friendly
  • Newton after William Blake by Eduardo Paolozzi 1995 at the British Library
    Permalink Newton after William Blake by Eduardo Paolozzi 1995 at the British LibraryGallery

    Standing on the shoulders of the Google giant: Sustainable discovery and Google Scholar’s comprehensive coverage.

Standing on the shoulders of the Google giant: Sustainable discovery and Google Scholar’s comprehensive coverage.

The 11th anniversary of Google Scholar passed yesterday. Max Kemman provides an overview of the growth and impact of the platform and also looks at why Google Scholar is virtually unrivaled. The scholarly community might ask whether it is entirely desirable that Google plays such an important role in the scholarly workflow. Not only does Google Scholar have a known effect on discovery and citation […]

Print Friendly
  • uk architecture
    Permalink Gallery

    Data enriched research, data enhanced impact: the importance of UK data infrastructure.

Data enriched research, data enhanced impact: the importance of UK data infrastructure.

Matthew Woollard discusses the importance of UK data infrastructure and how the systematic management and sharing of research data can lead to many benefits for the research community and the public. Here he introduces #DataImpact2015 where a panel of leading data innovators will explore data re-use in policy and research, sharing their experiences of demonstrating data enhanced impact.

The UK Data Service is trusted to […]

Print Friendly
  • michigan publishing
    Permalink Gallery

    Applied Altmetrics: How university presses, academic publishing services and institutional repositories benefit.

Applied Altmetrics: How university presses, academic publishing services and institutional repositories benefit.

Academic institutions are increasingly looking for ways to demonstrate the value and breadth of their publishing activity. Danielle Padula and Catherine Williams look at how one university, the University of Michigan, have incorporated altmetrics data as an author service to help academic colleagues articulate institutional-wide successes.

A key benefit of altmetrics for younger or smaller publishers is that, unlike the Thomson Reuters’ […]

Print Friendly
  • ruler
    Permalink Gallery

    When are journal metrics useful? A balanced call for the contextualized and transparent use of all publication metrics

When are journal metrics useful? A balanced call for the contextualized and transparent use of all publication metrics

The Declaration on Research Assessment (DORA) has yet to achieve widespread institutional support in the UK. Elizabeth Gadd digs further into the slow uptake. Although there is growing acceptance that the Journal Impact Factor is subject to significant limitations, DORA feels rather negative in tone: an anti-journal metric tirade. There may be times when a journal metric, sensibly used, is […]

Print Friendly
  • 1280px-Semaphore_Signals_A-Z
    Permalink Gallery

    Top ten tips for getting your research the attention it deserves

Top ten tips for getting your research the attention it deserves

Altmetrics offer a record of the wider attention and engagement that academic work generates and these broad indicators can provide a helpful starting point for understanding the influence and impact of your research. Danielle Padula and Catherine Williams provide ten simple steps for researchers looking to boost online engagement and wider attention of academic research.

Authors are facing more competition than ever for funding […]

Print Friendly
  • futility
    Permalink Gallery

    An antidote to futility: Why academics (and students) should take blogging / social media seriously

An antidote to futility: Why academics (and students) should take blogging / social media seriously

Blogs are now an established part of the chattersphere/public conversation, especially in international development circles, but Duncan Green finds academic take-up lacking. Here he outlines the major arguments for taking blogging and social media seriously. It doesn’t need to become another onerous time-commitment. Reading a blog should be like listening to the person talk, but with links.

Before I started […]

Print Friendly
  • altmetrics influence
    Permalink Gallery

    Enter Alternative Metrics: Indicators that capture the value of research and richness of scholarly discourse

Enter Alternative Metrics: Indicators that capture the value of research and richness of scholarly discourse

Many scholars have begun to turn to alternative metrics over traditional impact indicators as the online transmission and referencing of research outputs requires an updated understanding of how research makes an impact. Danielle Padula and Catherine Williams introduce the changing landscape.

This article is an excerpt from The Evolution of Impact Indicators: From bibliometrics to altmetrics, a collection on the state of […]

Print Friendly
  • web metrics featured
    Permalink Gallery

    We need informative metrics that will help, not hurt, the scientific endeavor – let’s work to make metrics better.

We need informative metrics that will help, not hurt, the scientific endeavor – let’s work to make metrics better.

Rather than expecting people to stop utilizing metrics altogether, we would be better off focusing on making sure the metrics are effective and accurate, argues Brett Buttliere. By looking across a variety of indicators, supporting a centralised, interoperable metrics hub, and utilizing more theory in building metrics, scientists can better understand the diverse facets of research impact and research quality.

In […]

Print Friendly
  • National_Woman's_Party_Suffragist_publishing_office_1916
    Permalink Gallery

    Opening-up the early stages of research: new journal RIO to publish research proposals.

Opening-up the early stages of research: new journal RIO to publish research proposals.

Research Ideas & Outcomes (RIO) is the latest scholarly journal seeking to fix the broken scientific publishing system. It has been created specifically to enable and encourage the entire research cycle to be published, including research proposals and ideas. Founding editor Ross Mounce outlines what the journal seeks to achieve and how it will speed up the publishing process by eliminating […]

Print Friendly
This work by LSE Impact of Social Sciences blog is licensed under a Creative Commons Attribution 3.0 Unported.