• Permalink Gallery

    The overall incidence of published replication studies in economics is minuscule – greater incentives are required

The overall incidence of published replication studies in economics is minuscule – greater incentives are required

Replicability is considered a hallmark of good scientific practice, an important post-publication quality check. But how many studies are chosen for replication? Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff, Gert G. Wagner have examined the economics literature and find that only one in one thousand publications are replication studies. The introduction of mandatory data disclosure policies may help to increase […]

Print Friendly
  • Permalink Gallery

    “Interdisciplinary, like everyone else.” But are you being interdisciplinary for the wrong reasons?

“Interdisciplinary, like everyone else.” But are you being interdisciplinary for the wrong reasons?

Interdisciplinarity is the talk of the town. Funding agencies favour interdisciplinary research proposals, teaching programmes focus on developing interdisciplinary courses, and the publication of interdisciplinary studies has surged over recent decades. Lakshmi Balachandran Nair considers whether interdisciplinarity remains a strategy to surpass the limits of the methodological tools, theories, and views offered by a single discipline or has instead […]

Print Friendly
  • Permalink Gallery

    Sandpits can develop cross-disciplinary projects, but funders need to be as open-minded as researchers

Sandpits can develop cross-disciplinary projects, but funders need to be as open-minded as researchers

The research “sandpit”, where a cross-disciplinary group of academics and practitioners come together for a short time to create new projects around a given theme, is gaining ground as a way to foster innovation and creativity in research design. While sandpits can spark ideas for novel projects better suited to tackling grand challenges and urgent questions, research from Kate […]

Print Friendly
  • Permalink Gallery

    It is advisor attitudes that are likely to shape students’ attitudes towards questionable research practices

It is advisor attitudes that are likely to shape students’ attitudes towards questionable research practices

In debates on the validity of academic research findings, focus has been drawn to so-called questionable research practices, commonly understood to encompass a laundry list of behaviours that can increase the likelihood of statistically significant (and so more publishable) results. Anand Krishna and Sebastian M. Peter report on research examining attitudes to questionable research practices among students who have […]

Print Friendly
  • Permalink Gallery

    Replication is both possible and desirable in the humanities, just as it is in the sciences

Replication is both possible and desirable in the humanities, just as it is in the sciences

Some scholars have claimed that replication – the independent repetition of an earlier study, answering the same study question, using the same or similar methods under the same or similar circumstances – is not possible in the humanities. The reasoning is that the humanities search for cultural meaning can yield multiple valid answers, and that research objects are people […]

Print Friendly
  • Permalink Gallery

    Learning to live with one another: lessons from an interdisciplinary research project

Learning to live with one another: lessons from an interdisciplinary research project

There is an increasing push from funders for researchers to undertake interdisciplinary projects. But while many want to do interdisciplinary research, few truly know quite how to. Ajoy Datta shares lessons from a recent interdisciplinary research project: understand that an ability to work well with others is as crucial as a researcher’s expertise, make time for regular collective reflection […]

Print Friendly
  • Permalink Gallery

    Nothing lasts forever: questions to ask yourself when choosing a new tool or technology for research

Nothing lasts forever: questions to ask yourself when choosing a new tool or technology for research

Academia has become increasingly reliant on third-party tools and technologies to carry out many of the processes throughout the research lifecycle. But there are genuine concerns about the sustainability of some of these tools and what the implications would be for users in the event they were discontinued. Andy Tattersall suggests a series of straightforward questions researchers should ask […]

Print Friendly
  • Permalink Gallery

    Contrary to common belief, randomised controlled trials inevitably produce biased results

Contrary to common belief, randomised controlled trials inevitably produce biased results

Much of the social and medical sciences depend on randomised control trials. But while this may be considered the foundational experimental method, a certain degree of bias inevitably arises in any trial; whether this is sample bias, selection bias, or measurement bias. This is important as the level of validity of a trial’s causal claims can be a matter […]

Print Friendly
  • Permalink Gallery

    To save the research literature, let’s make literature reviews reproducible

To save the research literature, let’s make literature reviews reproducible

Last week the Impact Blog featured a post from Richard P. Phelps, in which he proposed that journals get rid of their requirement for a literature review. Arnaud Vaganay agrees with much of what Phelps said, literature reviews are erratic and self-serving, but suggests doing away with them altogether is likely to make science less efficient and less credible. […]

Print Friendly
  • Permalink Gallery

    How eyes in the sky can cut survey costs and enable researchers to identify key but hard-to-reach populations

How eyes in the sky can cut survey costs and enable researchers to identify key but hard-to-reach populations

Collecting representative survey data on large populations of people can be a very time-consuming and expensive undertaking. But it doesn’t have to be; Marco J. Haenssgen and Ern Charoenboon explain how they have used freely available satellite images to survey hard-to-reach communities in Thailand and Laos.

Countries all around the world are thinking about how to tackle the growing problem […]

Print Friendly
  • Permalink Gallery

    Book Review: Cultivating Creativity in Methodology and Research: In Praise of Detours edited by Charlotte Wegener, Ninna Meier and Elina Maslo

Book Review: Cultivating Creativity in Methodology and Research: In Praise of Detours edited by Charlotte Wegener, Ninna Meier and Elina Maslo

The collection Cultivating Creativity in Methodology and Research: In Praise of Detours, edited by Charlotte Wegener, Ninna Meier and Elina Maslo, is comprised of short essays that offer imaginative detours from conventional academic wisdom to reflect on lived experiences of research. While the volume at times risks emphasising the unhappy aspects of academic life over and above the potential for […]

Print Friendly
  • Permalink Gallery

    Materiality of Research: can imaginative projects complement (and not displace) more critical research?

Materiality of Research: can imaginative projects complement (and not displace) more critical research?

Can projects of reimagining complement more critical research? Writing in response to comments on her recent work on reimagining the state, Davina Cooper addresses the challenge of developing transformative methods, the value of institutional play in academic research and the relationship these may have to more overtly “critical” accounts.

This version of this post first appeared on LSE Review of Books and […]

Print Friendly
  • Permalink Gallery

    Software updates: the “unknown unknown” of the replication crisis

Software updates: the “unknown unknown” of the replication crisis

The replication crisis is largely concerned with known problems, such as the lack of replication standards, non-availability of data, or p-hacking. One hitherto unknown problem is the potential for software companies’ changes to the algorithms used for calculations to cause discrepancies between two sets of reported results. Anastasia Ershova and Gerald Schneider encountered this very problem in the course […]

Print Friendly
  • Permalink Gallery

    Diary of an app! Will using mobile devices in qualitative research become the norm?

Diary of an app! Will using mobile devices in qualitative research become the norm?

Researchers have been asking participants to record their experiences and thoughts in traditional, paper-based diaries for many years. But the advent of digital technologies, especially apps for mobile devices, has encouraged some to ask whether these could become the new norm for capturing diary-based data for qualitative research. Laura Radcliffe and Leighann Spencer have pioneered the use of diary […]

Print Friendly
  • Permalink Gallery

    What a fossil revolution reveals about the history of “big data”

What a fossil revolution reveals about the history of “big data”

Improved technologies have allowed faster and more powerful statistical analysis and changed how we “see” data. It’s now taken for granted that the best way to understand large, complex phenomena is by crunching the numbers via computers and projecting the results as visual summaries. To David Sepkoski, that’s not a bad thing, but it does pose some challenges. The […]

Print Friendly
  • Permalink Gallery

    How people feel about what companies do with their data is just as important as what they know about it

How people feel about what companies do with their data is just as important as what they know about it

The recent revelation that Cambridge Analytica was able to acquire the Facebook data of 50 million people has led to a surge of interest and questions around what companies do with people’s data. Amidst all of this, little attention has been paid to the feelings of those whose data are used, shared, and acted upon. According to Helen Kennedy, […]

Print Friendly

statcheck – a spellchecker for statistics

A study has revealed a high prevalence of inconsistencies in reported statistical test results. Such inconsistencies make results unreliable, as they become “irreproducible”, and ultimately affect the level of trust in scientific reporting. statcheck is a free, open-source tool that automatically extracts reported statistical results from papers and recalculates p-values. Following an investigation into its accuracy, Michèle B. Nuijten […]

Print Friendly
  • Permalink Gallery

    More room for greater depth and detail: implications for academic research of Twitter’s expanded character limit

More room for greater depth and detail: implications for academic research of Twitter’s expanded character limit

Twitter makes its data available in real-time and at no cost, making it a popular data source for many academic researchers. Wasim Ahmed discusses some of the implications of the decision to expand the character limit from 140 to 280. Greater space makes for greater depth and detail, addressing the difficulties of interpretation that 140-character tweets would sometimes present. […]

Print Friendly
  • Permalink Gallery

    Ever wondered why practitioners treat researchers like a nuisance? The challenges of accessing expert knowledge, from both perspectives

Ever wondered why practitioners treat researchers like a nuisance? The challenges of accessing expert knowledge, from both perspectives

The difficulty of reaching practitioners and experts is one of the main challenges faced by early-career researchers in particular, and one that can overshadow fieldwork experiences and attempts to produce new knowledge. While researchers might feel that they are being ignored or treated as a nuisance by experts, the latter often have a different view of researchers’ attempt to […]

Print Friendly
  • Permalink Gallery

    More data or better data? Using statistical decision theory to guide data collection

More data or better data? Using statistical decision theory to guide data collection

When designing data collection, researchers must take important decisions on how much data to collect and what resources to devote to enhancing the quality of the collected data. But the threshold for choosing better over bigger data may be reached long before the sample numbers in the thousands, write Jeff Dominitz and Charles F. Manski.

Big data has become an […]

Print Friendly
This work by LSE Impact of Social Sciences blog is licensed under a Creative Commons Attribution 3.0 Unported.