Discover more from Overcoming Bias
Compared to academics, non-academics have a less idealistic view of academia. For example, compared to academic economists, non-academic economists see less social value and progress in economics research, more researcher gender influence on that research, and more journal favoritism toward those at top schools or with inside connections. From a new paper in the American Journal of Economics and Sociology, reporting on a survey of 323 members of the American Economic Association:
62 percent were academic economists, of which 31 percent had completed their doctoral degree … Among academic economists, nearly half were full professors; … Only those in departments offering graduate economics degrees generally believe that [economic] research entails spillover benefits [to society]. Further, academic economists actively publishing generally agree that economic research is improving in explaining economic behavior and events; academic economists inactive as publishers generally do not. Academic economists disagree that a person’s status as a reviewer for a nationally recognized journal influences whether his or her research will be published in that journal; nonacademic economists generally agreed, however.
Academic rank is important in explaining differences of opinion related to gender influence in the discipline; professors of economics generally disagreed that the gender composition of the profession influences its research agenda. Academic economists with less than full professor rank generally did not. Full professors generally disagreed that reviewers at nationally recognized journals have a higher likelihood of their articles being published in that journal. Those of lesser rank generally agreed, however.
Self-interest bias seems an obvious explanation for this disagreement. I seem to have avoided this bias, since I am an academic economist whose opinions better match non-economists. Here are more results:
Respondents expressed a strong affirmative opinion … with much consensus … that a paper’s degree of mathematical exposition influences the probability it will be published in a nationally recognized journal; … Nearly 68 percent of the respondents agreed that author recognition among professional economists was important in determining article acceptance at a nationally recognized journal. … school or business affiliation influences the probability of article acceptance in nationally recognized journals; 56 percent agreed, … A majority of respondents (60 percent) also agreed that a "good-old-boy" network in the profession influences the probability of article acceptance, … 52 percent of the respondents agreed that a person’s status as a reviewer for a nationally recognized journal increases the probability that his or her article will be published in that journal; … However, 45 percent of the respondents agreed that most articles are published in nationally recognized journals solely on the basis of scientific contribution.
I’m not sure this last view is consistent with the other views expressed.
Academic Self-Interest Bias
Thanks Barkley.
Are there people doing tests of these sort of things? Getting papers published under different names (setting it up on different websites, if need be) to check what happens to the paper? Just knowing that such tests were taking place may be enough to get reviewers to do their job more properly.
Following Carl Shulman, another reason there may be less contradiction than appears is indeed the potential for Boolean fuzziness here. So, my own view, sitting in an editor's chair, is that a majority of decisions do mostly reflect "scientific value." At the same time, some of these other biases are certainly operating, in some cases in varying degrees according to journal. I would tend to agree that the high guess on "author recognition" is right, especially when we are talking about authors who are really at the top of prestige in the profession, like Nobel Prize winners.
Regarding good old boy networks and institution bias, I think these are very journal specific. Thus, it has long been widely believed that two of the top four econ journals have strong such biases, the Quarterly Journal of Economics, based at Harvard, and the Journal of Political Economy, based at Chicago. OTOH, I have seen at least one article that claimed that the papers published in those journals that came out of their respective institutions were actually the better ones in terms of citations, providing the warning that sometimes good old boy networks lead to the pals of the editors sending them their best papers. Not such a simple matter after all.