We can only dream of tracking how research changes the way practitioners act in the real world… or can we? Cameron Neylon writes that Twitter can serve as a measure of the impact of researchers on digitally-literate professionals.
The holy grail of research assessment is a means of automatically tracking the way research changes the way practitioners act in the real world. How does new research influence policy? Where has research been applied by start-ups? And have new findings changed the way medical practitioners treat patients? Tracking this kind of research impact is hard for a variety of reasons: practitioners don’t (generally) write new research papers citing the work they’ve used; even if they did their work is often several steps removed from the original research making the links harder to identify; and finally researchers themselves are often too removed from the application of the research to be aware of it. Where studies of downstream impact have been done they are generally carefully selected case studies, generating a narrative description. These case studies can be incredibly expensive, and by their nature are unlikely to uncover unexpected applications of research.
In recent talks I have used a specific example of a research article reaching a practitioner community. This is a paper that I discovered will search through the output of the University of Cape Town on Euan Adie‘s Altmetric.com service. The paper deals with domestic violence, HIV status and rape. These are critical social issues and new insights have a real potential to improve people’s lives, particularly in the area of the study. The paper was tweeted by a number of accounts but in particularly by @Shukumisa and @SonkeTogether; two support and adovcacy organisations in South Africa. Shukumisa in particular tweeted in response to another account “@lizieloots a really important study, we have linked to it on our site”. This is a single example but it illustrates how it is possible to at least identify where research is being discussed within practitioner and community spaces.
But can we go further? More recently I’ve shown some other examples of heavily tweeted papers that relate to work funded by cancer charities. In one of those talks I made the throw away comment “You’ve always struggled to see whether practitioners actually use your research…and there are a lot of nurses on Twitter”. I hadn’t really followed that up until yesterday when I asked on twitter about research into the use of social media by nurses and was rapidly put in touch with a range of experts on the subject (remind me, how did we ask speculative research questions before Twitter?) . So the question I’m interested in probing is whether the application of research by nurses is something that can be tracked using links shared on Twitter as a proxy?
The is interesting from a range of perspectives. To what extent do practicing nurses who use social media share links to web content that informs their professional practice. How does this mirror the parallel link sharing activity by academic researchers? Are nurses referring to primary research content, or is this information mediated through other sources? Do such other sources link back to the primary research? Can those links be traced automatically? And a host of other questions around how professional practice is changing with the greater availability of these primary and secondary resources.
My hypothesis is as follows: Links shared by nurse practitioners and their online community are a viable proxy of (some portion of) the impact that research has in clinical practice. The extent to which links are shared by nurses on Twitter, perhaps combined with sentiment analysis, could serve as a measure of the impact of research targeted at the professional practice of nurses.
Note: This article gives the views of the author(s), and not the position of the Impact of Social Sciences blog, nor of the London School of Economics.
Your hypothesis uses shared tweets as proxy and I think that is likely the best twitter can do. The link is shared. That is discoverable. Was the link clicked through? If they used a bit.ly shortener that is also discoverable as bit.ly tracks the use of the tweet. Was the article downloaded? Maybe also trackable if the analytics are provided. Then we hit a wall because you can’t then assess if the article that was downloaded was read, adopted to the local clinical context, practiced and then the practice change evaluated.
Twitter is a tool for sharing. But there’s a long way to go between sharing and implementation. Twitter as a proxy at least gets you started because as you started out, “Tracking this kind of research impact is hard for a variety of reasons”.
Thanks for sharing your thinking on great ways to use twitter.
Possibly need to be careful though, as these Twitter nurses may be nowhere near representative of your average nurse. I carry out healthcare market research projects, including looking at nurse practise, and from my experience a high proportion are on the lower end of IT savvy (no offense intended!). I guess you can work on the assumption than knowledge filters through communities of healthcare professionals to some extent…
Nurses on twitter, a debatable platform on whether a good amount of information can be gathered and whether they are a true representation of other nurses on the ground