It is widely accepted that academic papers are rarely cited or even read. But what kind of data lies behind these assertions? Dahlia Remler takes a look at the academic research on citation practices and finds that whilst it is clear citation rates are low, much confusion remains over precise figures and methods for determining accurate citation analysis. In […]
Geographies of knowledge: practical ways to boost the visibility of research undertaken and published in the South.
Jonathan Harle and Sioux Cumming discuss how to strengthen research networks in developing countries. There is still a huge body of Southern research which simply never gets counted. Research that is undertaken and published in the South needs to be valued, and this will only happen when Southern universities value it in their reward and promotion systems and when research funders recognise […]
University rankings wield immense influence over Higher Ed and society at large – with positive and perverse effects.
In a time of growing demand for and on higher education, university rankings have transformed university strategy. Ellen Hazelkorn finds their crude simplicity is what makes rankings so infectious. Yet, quality is a complex concept. Most of the indicators used are effectively measures of socio-economic advantage, and privilege the most resource-intensive institutions and-or countries. In response and reaction to the limited […]
“Re-purposing” data in the Digital Humanities: Data beg to be taken from one context and transferred to another.
While scientists may be well-versed in drawing on existing data sources for new research, humanists are not conditioned to chop up another scholar’s argument, isolate a detail and put it into an unrelated argument. Seth Long critically examines the practice of re-purposing data and finds data in the digital humanities beg to be re-purposed, taken from one context and […]
The h-index attempts to measure the productivity and impact of the published work of scholar. But reducing scholarly work to a number in this way has significant limitations. Stacy Konkiel highlights four specific reasons the h-index fails to capture a complete picture of research impact. Furthermore, there are a variety of new altmetrics tools out there focusing on how to […]
Moneyball for Academics: network analysis methods for predicting the future success of papers and researchers.
Drawing from a combination of network analysis measurements, Erik Brynjolfsson and Shachar Reichman present methods from their research on predicting the future success of researchers. The overall vision for this project is to create an academic dashboard that will include a suite of measures and prediction methods that could supplement the current subjective tools used in decision-making processes in academia. The big data revolution […]
A Bayesian approach to the REF: finding the right data on journal articles and citations to inform decision-making.
Now that the REF submission window has closed, a small panel of academics are tasked with rating thousands of academic submissions, which will result in university departments being ranked and public money being distributed. Given the enormity of the task and the scarcity of the resources devoted to it, Daniel Sgroi discusses a straightforward procedure that might help, based on the […]
As the REF submission period ends, mismatched publishing incentives signal challenging times ahead in academia.
Academics are frequently subject to new types of evaluations. November marks the end of the submission process for the UK funding council’s evaluation, the Research Excellence Framework (REF). John Hudson discusses some of the shortcomings of the REF and the methods individual papers are ranked. New evaluations and requirements change the incentives of economists and can affect their research – sometimes […]
Universities can improve academic services through wider recognition of altmetrics and alt-products.
As altmetrics gain traction across the scholarly community, publishers and academic institutions are seeking to develop standards to encourage wider adoption. Carly Strasser provides an overview of why altmetrics are here to stay and how universities might begin to incorporate altmetrics into their own services. While this process might take some time, institutions can begin by encouraging their researchers to recognize the importance […]
The usefulness of citation counts depends heavily on the context of an individual’s publishing community.
Are citations the best way to assess a scientific researcher’s worth? David Laband argues that although citation counts are easy to quantify and broadly indicative, they ultimately provide limited information and should only be used with a healthy dose of caution and common sense. At stake is the distribution of enormously important scientific resources, both public and private. Let me […]
What would happen if researchers were given more control over their own funding and the funding of others? Hadas Shema looks at the results from an article that makes the case for a collective approach to the allocation of science funding. By funding people directly rather than projects, money and time would be saved and researchers would be given more […]
Libraries can embrace the use of altmetrics as a means to strengthen the functionality of institutional repositories.
With the expansion of digital scholarship, alternative metrics have emerged as a useful way to measure the impact of scholarly outputs beyond traditional citation counts. LSE Research Online has recently added an altmetrics tool to display the ways in which LSE research is being used in this broader social landscape. Lucy Ayre provides further background on why this addition is beneficial for the Library […]
The LSE’s Centre for Learning Technology looks ahead to Anne-Wil Harzing’s talk on the impact of citation analysis and Sonja Grussendorf reflects on the course of the seminar series which has looked at how technological developments, particularly the internet, have led to changes in the way researchers and higher education institutions can understand their role in facilitating knowledge creation. Last year, […]
Funders and the wider research community must avoid the temptation to reduce impact to just things that can be measured, says Liz Allen of the Wellcome Trust. Measurement should not be for measuring’s sake; it must be about contributing to learning. Qualitative descriptors of progress and impact alongside quantitative measurements are essential in order to evaluate whether the research is actually making a difference. Learning […]
The Open Researcher and Contributor Identifier, or ORCID, is a non-profit effort providing digital identifiers to the research community to ensure correct authorship data is available and more transparent. Brian Kelly welcomes the widespread adoption of the unique ORCID ID arguing that it should be a particular priority for researchers whose position in their host institution is uncertain: which is to […]
The hidden map of science: Pre-publication history of articles tells us that rejection leads to higher citations
No-one wants to have their paper rejected by a top journal, but is there a silver lining to an initial disappointment? Vincent Calcagno finds that papers that are resubmitted to a second or third choice journal enjoy a ‘benefit of rejection’ and are more likely to receive a higher number of citations when published. Every scientific author or editor has […]
There’s something fishy about citations: We need a method of assessing the support of research if we want to change the ‘publish or perish’ culture
Current citation biases give us only the narrowest slice of scientific support. Bradley Voytek writes that while BrainSCANr may have flaws, it gives the reader a quick indication of how well-supported an academic argument is and could provide a new way of thinking about citations. Science has a lot of problems. Or rather, scientometrics has a lot of problems. Scientific […]
We can do much better than rely on the self-fulfilling impact factor: Academics must harness ideas of engagement to illustrate their impact
Impact Factors are a god-send for overworked and distracted individuals, and while Google Scholar goes some way to utilizing multiple measures to determine a researcher’s impact, Jonathan Becker argues that we can go one better. He writes that engagement is the next metric that academics must conquer. Those of you in the professoriate are likely in the same position as […]