31 Comments

But in a sports contest, especially ones involving teams, many of those doing the affiliating are affiliating with the losing team, and continue to do so, usually, even if the team loses. They are paying to attend to see their team compete with the hope that they are going to win, or at least play well.

Those reading journal articles, especially those purchasing subscriptions to the journal, are doing so to read the articles published in the journal, or perhaps to affiliate with the journal. But do these people think about "affiliating" with the authors or titles of papers rejected for publication? Certainly not in the same way that fans affiliate with a losing team, or in the case of more individualized sports such as tennis or golf, with a losing player.

Expand full comment

Barkley, I only suggested publishing titles/authors/dates. You say for sports "the contest ... is the activity" but "for academic .. the bottom line is ... the contents of the ... paper" but to me that just seems another way to rephrase the question. I see both industries as ultimately allowing customers to affiliate with certified impressive folks, so the issue is about different ways to sort/certify impressiveness.

Expand full comment

Robin,

Your main examples are sporting events and contests versus publishing academic research. I do not think the matter really has to do with individual incentives as much as it doew with the structure and nature of the respective activities. Thus, for sports, the contest between the rival participants is the activity, both when it is amateur and when it is professional, whereas for academic published research the bottom line is publicizing appropriately the contents of the "winner's" paper, not the contest between it and other papers not published.

This is clearest for the case of professional sports, where the outcomes involve peoples' livelihoods, just as in academia, who gets to publish and where affects the livelihoods of those involved, especially for junior faculty atempting to get tenure in an academic department. The money in professional sports comes from audiences paying to watch the contest between the contestants. Certainly there come to be greater financial rewards from those who win more often than those who do not (and are perceived as playing well). But even those who lose in the games, the players are providing a service for the spectators and thus deserve to be paid, at least somewhat. If there were no losers, there would be no games.

In academic research, if there were enough pages in journals available, all research could be published, assuming that somebody is keeping an eye out to make sure that totally false garbage does not get through. Much of what goes on in most fields is that there are page limits for each journal on how much can be published. Thus, the high rejection rates one sees for more highly ranked economics journals do not mean that those who "lose" are doing anything bad or awful. Most papers rejected from the journal I edit are not all that bad, indeed I would say only about 5% of submissions are just awful and totally unpublishable anywhere. Most papers submitted have some sort of original idea and are not completely incompetent. So, it is a matter of selecting the best papers to publish out of a set of possible ones. The point for the "spectators," the readers of a journal, is seeing the papers that make it through the selection process to get published.

There is also another problem not mentioned so far: copyrights. It might be one thing to print titles of papers and names of authors (and perhaps of editors and referees). But, the minute one starts talking about actually "publishing" the papers themselves (as some thinking about this think is what should be done) one runs into ruining the chance of a paper ever being properly published because of copyright. Also, if a paper is rejected, does one "publish" the first draft, the last revision? Does one publish the desk rejects? Does one reveal to the public all these details, that this paepr was desk rejected while that one went through four revisions before finally getting the axe?

Expand full comment

Barkley, I am not trying to improve the journal system here; I'm trying to understand human nature. Why do some forums where folks compete for awards hide the identities of losers, while other forums reveal them? This seems an interesting and potentially insightful data point. Yes, high refunded-if-accepted submission fees are a similar phenomena.

Expand full comment

Although no one has commented on my comment, I am going to add a bit more here. It is fine for the Mason lunch crowd that likes to bet with itself and blog hard until the food falls off the table to view research and acceptances and rejections as a sports contest, and certainly some parts of it can look like that, especially the tournament aspect of Nobel prizes or who gets the top chairs in the top departments and some other things of that sort. But I do not think journal publishing should resemble that, or at least certainly not as much.

Let me note that there are many people who find it hard even to submit papers to journals at all because they suffer great personal pain from the rejections they receive, which although usually the editors are more or less kindly, sometimes the referee reports can be harsh and insulting and demeaning, not to mention unfair and inaccurate. So, adding the stress of possibly being publicly reported on as having been rejected simply adds to this problem.

Now, Robin poses the idea of the possible efficiency of "raising the bar." This argument has been floating around for a number of other proposals (or realities) as well. Thus, Ofer Azar has published papers arguing that the steadily increasing average time of first response by journals in economics is potentially efficient on these grounds, raising the bar for authors who misjudge the appropriate level of journal to which they should be submitting. Of course, this is the opposite of what is done in the natural sciences, where rapid turnarounds and publicatin are strongly emphasized, and most authors do not like such slow turnarounds (just as I suspect most would not like public revelation of their rejections).

Another way this is done is that certain journals have very high submission fees that are then refunded to authors whose papers are accepted, $650 at the Journal of Financial Economics and a high one also at the Journal of Monetary Economics (both dominated by the sorts of models that are now looking very stupid and useless in the wake of the recent crises in the financial markets). They make this efficiency argument, although it tends to weed out anybody submitting who does not buy into their somewhat distorted view of things (and in the natural sciences one tends to find just the opposite, with there being no submission fees, but then often page fees for authors who are getting published).

Expand full comment

As a journal editor, let me throw in a few observations. One, unmentioned so far, is that, believe it or not, most of us editors actually have sympathy for those who submit their papers to us. However, in economics, unlike perhaps in astrophysics, the majority of papers get rejected. At my journal the rejection rate is around 85%. Furthermore, about half the papers submitted get "desk rejected" by me upfront without being sent out for reviews (refereeing time is indeed a very scarce commodity).

So, we would be talking about huge numbers of papers, and talking about humiliating large numbers of people. For what purpose? Research is not a sports contest.

I also note that there is a rather famous history of famous papers that were rejected, some of them by many journals. There just is not much of a gain for the journals in doing this sort of thing.

Expand full comment

Most academic papers are rejected by several journals before some journal finally accepts them.

Is this really true? It is certainly not the case in my field (astrophysics) where being rejected by a journal is unheard-of unless you are a crackpot operating from some dank basement (in which case no other journal would accept the paper either).

Expand full comment

Re: A journal could simply make rejected papers available online

Any journal that published "rejected" papers in a corner of its web site would screw up the author's chances of getting their then "previously-published" papers accepted elsewhere. Authors would not stand for that - and would avoid that publication like the plague. So, journals do not do this through simple self-interest.

Expand full comment

Assuming that no author is absolutely confident in his ability to be accepted, and that public rejection hurts publishing prospects at other papers; it seems that any one journal publishing the rejections would drive away papers of its prestige level (as they would approach a journal a rung lower rather than take the risk of dropping several rungs) on the other hand it would attract submissions of a much lower level hoping for a long shot. It seems that there are stable equilibriums at universal publication or non-publication). Perhaps a journal which is at the top of its pyramid such that it doesn't face significant competition for its paper submissions (not certain about relative prestige, but perhaps Nature would be at that level) might be able to do it unilaterally, but that type of journal can only lose from publishing rejection.

Expand full comment

As more and more journals become for-profit, do we know that papers are rejected based on quality? I mean, a for-profit has tight space constraints. They may like a paper "enough" but just run out of space! Why not just pop everything onto the 'net that meets a certain quality, even if it doesn't have room for the paper version? Not being an academic, I don't know if this would work. . .

Expand full comment

I think this is an interesting idea.

Historically, I would guess journals do not publish rejected papers because it wastes resources to typeset and print them. The whole point of a selection process is one way or another to conserve resources.

However, nowadays journals (at least in fields in which I am familiar) are electronic. In physics, the papers are often available at a public online archive. This opens up more possibilities. A journal could simply make rejected papers available online, thus dramatically saving costs. Better yet, it might suffice to make available just the authors and the title (and maybe abstract, if it worried authors will change titles to disguise work). This saves dramatically on typesetting; meanwhile if the paper is published elsewhere, it can be found, if not, I presume it's not of much concern.

Expand full comment

Why do no journals publish their rejections? Probably because their readers are not interested in wading through - or paying for - material that the editors judge to be a load of unprintable garbage.

Expand full comment

Carl, the price of the freedom to submit more stuff is the obligation to put in more time reviewing the work of others.

Expand full comment

If your objective is to better match supposed top quality research to supposed the top quality journals my guess is that this mechanism would make that goal less likely.

I suspect that this disclosure mechanism increase the potential for misleading information cascades. For example, given you have been fairly or unfairly rejected by Journal A, is Journal B, more likely or less likely to give your paper an objective review if it knows that Journal A rejected you. I think its less likely you will get a fair assessment from Journal B.

Expand full comment

Paul,

Peer reviewers are usually unpaid volunteers, their time is scarce and behavior such as you describe contributes heavily to long delays from submission to publication.

Expand full comment

I guess part of the question is who would we trust to filter out potentially bad papers? Risk-averse researchers or editors and peer reviewers? I'd rather have a system in which people can fearlessly send out anything they think might be interesting, knowing the only consequence to a rejection is loss of time, and get the informational benefit of having editors and peer reviewers looking at it. (Unless workshops can take up the slack for that?)

Expand full comment