Friday, July 7, 2017

Today I became dreaded reviewer #3

I am now writing a referee report. I usually frame my comments diplomatically and try to be constructive (you will have to take my word for it...). Unfortunately, my first comment to these authors is uncharacteristically harsh, and I wish I had not needed to write it:
"I do understand that productivity and impact metrics like the number of citations, h-index, etc. are wrongly used by intitutions and funding agencies to measure research productivity, and that scientists are implicitly (or explicitly) pressured to inflate them. I cannot, in good conscience, agree with that practice but would have kept silent if a manuscript cited a couple of papers by the authors in the introduction. However, in this manuscript 46 references are cited, of which 23 (number 8-11, 15-19 , 21-23 , 34-42 , 44-45) are from the current authors. None of these 23 citations refers to specific results from those papers: they are rather cited as examples of well-known facts which either require no citation or should cite seminal papers/reviews in the area. I will not accept this paper in any form, for publication in this or any other journal, if those references remain."

I am afraid such comments to authors and editords must become much more common to stop the continuous gaming of the system. As long as metrics are used for ends they were not designed to, authors will (more or less grudgingly) try to game them, if only to ensure that they do not "fall behind" in comparisons with colleagues who feel even less compunction to game. Race to the bottom, and all that...

Thursday, April 28, 2016

New scientific biographies wanted....

Biographies fulfill several different roles: they may simply satisfy one's curiosity over the lives/achievements of the biographees, provide tasty morsels of gossip or interesting stories, or play an "educational" role. Traditionally, the "educational role" of biographies has focused on their presentation of "role models" - whether moral, political or social - or the conditions/life experiences which led to the special significance of the biographee. Scientific biographies follow the same pattern. Like traditional biographies, they are usually limited to people of special significance: trailblazers, mavericks, geniuses, and people who left a mark on their scientific discipline or on the public perception of the worth of their subject.

I wish there were also another kind of biography, devoted to the intelectual careers of "normal" researchers: people who simply follow their intelectual curiosity, who are constrained by the amount of funding they can get and who pass away in obscurity after adding their small contributions to our colective knowledge. I do not want "human interest stories" played by researchers: I rather long for a description of their intelectual journeys, why they decided to study a specific problem, what kinds of mental connections they made (and why), in what measure their interpretation of their results was "commonplace" or (in contrast) specifically triggered by insights coming from seemingly unrelated work they had performed earlier, etc.

I want to read stories that show how each of these normal people, in their own way, made work which seems ordinary but is, in contrast, highly personal: work that would not have been done, or which would not have yielded the same insights, if that scientific question had been tackled by someone with a different research history. I am reasonably confident that most rank-and-file scientists would be fitting subjects for this style of biography, and that the study of these stories would teach us a lot about the roles that creativity, personality, luck and culture play in the fostering of a thriving research environment.