LSE - Small Logo
LSE - Small Logo

Blog Admin

November 20th, 2012

More papers, better papers? The curious correlation of quality and quantity in academic publishing

12 comments | 6 shares

Estimated reading time: 5 minutes

Blog Admin

November 20th, 2012

More papers, better papers? The curious correlation of quality and quantity in academic publishing

12 comments | 6 shares

Estimated reading time: 5 minutes

Paul J. Silvia is creeped out by the correlation between quality and quantity in academic publishing, but why do the people who publish the most also publish the work that has greatest influence?

Gregory Feist—a distinguished creativity researcher at San Jose State University—is not a haunting man, but his research on scientific eminence creeps me out. One of his early papers—“Quantity, Quality, and Depth of Research as Influences on Scientific Eminence: Is Quantity Most Important?”—strikes chills in the hearts of thwarted writers who suspect they aren’t publishing enough. As you’d suspect from the title, his research (on university biologists, chemists, and physicists) found that the mere quantity of publications was the largest predictor of eminence, assessed via citation rates, awards and distinctions, professional visibility, and peer evaluations of research contributions.

This is creepy stuff indeed, especially to those of us who are reading or writing blog posts on writing as part of a sophisticated and self-deceiving procrastination strategy. Before picking at the nits on Feist’s study, Feist isn’t the only scientist to find this effect. A huge correlation between quality and quantity is found for nearly anyone who looks. This fact forms the basis for many theories of scientific impact and eminence, such as Dean Kean Simonton’s influential writings.

Why are quality and quantity related? Why do people who publish a lot of work also publish work that has a greater influence? The quality-quantity correlation, like any other correlation, can reflect many causal directions. Here are a few speculations:

  • Writing both improves and creates ideas. Most people think of writing as a kind of transcription: we gather our facts, form our ideas, and hit the mental “Print” button to output what we know. Instead of being the endpoint of a knowledge-creation cycle, however, writing is often the beginning. Quality and quantity might be linked because the process of writing improves quality, by forcing us to confront and sharpen our ideas, and quantity, by sparking more ideas. In Writing to Learn, William Zinsser argued that writing was a way to create knowledge, a way to understand what we half-know. Grappling with our ideas makes them more sophisticated and eventually sparks some new ones. As anyone who writes regularly knows, writing about one thing leads to ideas for new projects. Robert Boice, in Professors as Writers, showed that forcing professors to write daily caused a sharp increase in text output but also a many-fold increase in the number of new ideas for writing. Writing begets good ideas, which beget more writing.
  • Early quality or quantity attracts resources that foster both. Here in the United States—where we are free from the REF madness but afflicted by a few peculiar American maladies—early publishing success opens access to contexts, cultures, and institutions that foster more success. Someone with a hot early career might receive a federal training grant—thus jumpstarting a research program and reducing time spent teaching—and get hired at a resource-rich department with low teaching loads, energetic doctoral students, and a warm intellectual climate. In this case, the quality-quantity correlation is a spurious result of what creativity science calls a “Matthew Effect”—the rich get richer by virtue of access to training, resources, and opportunities.
  • Quantity attracts positive attention from peers. Writing is hard, so people who do a lot of it stand out. Because quantity is noticed and valued, it can spark a cycle that leads to markers of quality, such as more citations and a stronger reputation. In a small subfield, one person can generate a notable proportion of publications. High quantity then attracts positive attention from peers, which leads them to read the papers, assign them to students, and cite them in their own work. Beyond attracting attention, quantity attracts citations through mere probability: more papers, however humble, mean more potential things for a domain of scholars to cite. Unlike the prior two, this explanation implies that quantity begets an impoverished kind of quality—the work merely gets more attention and citations, not genuine improvement.

These three paths strike me as reasonable possibilities—all three might have some merit, but the quantity-quality correlation still vexes me. Have some explanations of your own? The comments section—a warm home for creators and procrastinators alike—awaits.

 

Note: This article gives the views of the author(s), and not the position of the Impact of Social Sciences blog, nor of the London School of Economics.

About the author:
Paul J. Silvia, an Associate Professor of Psychology at the University of North Carolina at Greensboro, is the author of How to Write A Lot: A Practical Guide to Productive Academic Writing.

Print Friendly, PDF & Email

About the author

Blog Admin

Posted In: Academic communication | Impact

12 Comments