The “Give Us More Money” Bias

Twenty years ago I reviewed the academic literature on the social return to government-funded research, and found it to be one of the most biased I have ever seen; the clear agenda was to lobby for more research money.   I just went looking for more recent developments and found a meta-analysis by farm research advocates.  The average annual rate of return studies found was over 80%, but there were some serious biases:

This study includes a comprehensive database of literature on returns to research … Overwhelmingly, evaluations related to crop research. The original database included 292 publications reporting 1,886 observations. …  Lower rates of return are reported when:  … both research and extension effects are included (relative to either alone), the analyst is employed by a university (versus government), the analyst is employed by the private sector (versus government), … the research scope is for a program (versus a single project), the research scope is for one or more institutions (versus a single project), the evaluation is published in a refereed journal compared with less formal outlets, … a longer gestation lag is used.

That is, they get higher estimates for the value of research when they can more easily cherry-pick the best-looking cases, and when the standards of evaluation are the lowest.  Of course the very hard question is how to correct for these biases when assessing the average rate of return. 

GD Star Rating
loading...
Tagged as:
Trackback URL:
  • Bruce G Charlton

    Sorry to be somewhat off topic – but maybe this ‘lobbying for state funding’ aspect of research partly explains the liberal-left preponderance of academics – which (as Engram notes today at Back Talk – http://engram-backtalk.blogspot.com/2007/03/academics-scientists-and-politically.html) infects all academic science that has political ramifications.

  • http://profile.typekey.com/jhertzli/ Joseph Hertzlinger

    The fact that the first piece of expert advice
    is to hire more experts and give them high-status positions has been known for millennia:

    “Now let Pharaoh take a man discreet and wise and set him over the land of Egypt.” — Genesis 41:33