The gold standard of modern social science is … a “random controlled trial.” … And yet… real-world policy-makers continue to neglect, evade, and actively oppose experimental tests of efficacy. … Tim Harford explains why:
Politicians resist pilot schemes with objective measures of success. … politically inconvenient is the fact that half of the pilot schemes will fail… so the pilot will simply produce stark evidence of that failure. …
This is all a nice example of a theme I’ve been pushing for a while ….
Political agency problems are often a byproduct of voter irrationality. The principals give their agents grossly suboptimal incentives, then complain that the agents fail to carry out their assignments. … Pay-for-performance is a good idea, but the public is too irrational to accept it.
Note that private CEOs are also quite reluctant to run randomized trials of their business ideas. Yes some trials happens in marketing, but firms overall still display a puzzling neglect of randomized trials, and of prediction markets. Both mechanisms offer more accurate info, but at the cost of a high rate of clear public embarrassments – clear evidence showing that you endorsed crap.
Yes firms do implement incentive pay more often, but firms still remain puzzlingly reluctant to correct such incentives for overall trends in the economy or the local industry. Maybe voters are more reluctant than stockholders to discipline their agents, making the private sector more efficient at managing many forms of activity. But in both cases there remains a puzzling reluctance to force leaders to prove their value.
My hypothesis: leaders have status, with which voters and stockholders want to affiliate. While people talk about being offended by leader dominance, they are actually quite eager to submit, and reluctant to risk leader wrath by questioning leader quality. The people’s romance with the state makes them even more reluctant to hold political leaders accountable, so this effect is even worse in politics.
I don't think the romance is with the state, I think it is with leadership and organizations. Further, it seems the evidence favors the romance: large organizations with charismatic leaders accomplish a tremendous amount.
Where are the weak states that have won wars and therefor kept themselves in existence? Where are the "democratically run" large corporations outperforming their more orderly brethren because they better exploit the pushing of decision making further towards the edges than the center? Where are the great railroads and oil companies that evolved with a laissez faire attitude from the top?
Some of us think we are individuals, perhaps that is the bias we need to overcome in order to understand humanity. The evidence seems to be that we are not THAT much smarter than chimps or bonobos or whales. What we are is insanely better communicators, both through language and through the apparent instict to trade that Ridley talks about in the Rational Optimist. Our left arm and our right arm don't develop separate theories of individualtiy until the corpus collosum is cut. But what of the group mind? We have a strong connection between or right and left brains, we have a weaker connection to a myriad of other brains on the planet through talk, writing, radio, and internet. While our individual brain is not yet mechanized, we have been mechanically aiding our group brain starting with writing and accounting on clay tablets and going up from there.
Perhaps some part of the group brain needs to organize the efforts of the other prarts. Perhaps other parts LIKE to be organized and have even evolved to like it since it creates a more effective group brain which has been incredibly valuable in natural selection as well as in building collosea and getting to North America and later, to the Moon.
Maybe the love of leaders is a feature to be managed, and not at all a bug.
My experience teaching at a business school has been that the sort of education necessary to become good at this sort of social science is antithetical to the self-image of business students. Science is "theoretical," for geeks, and not for square-jawed straight-talking "leaders". Internal accountability is fine, but thinking of business plans or relevant parts of business plans in terms of serious on-going empirical research about the social environment, either taken from other sources or generated in house, is not a good fit with the culture of MBAs.