Is Overcoming Bias Important?

Arnold Kling says he "does not buy this argument" of mine:

If you have a cause, then other people probably disagree with you …  When other people disagree with you, they are usually more right than you think they are. … Before you go and attach yourself to this cause, shouldn’t you try to reduce the chances that you are wrong? Ergo, shouldn’t you work on trying to overcome bias?

Tyler Cowen riffs:

[Such] views are tautologically true and they simply boil down to saying that any complaint can be expressed as a concern about error of some kind or another.  … draw an analogy with statistics.  Biased estimators are one problem but not the only problem.  There is also insufficient data, lazy researchers, inefficient estimators, and so on.  Then I don’t see why we should be justified in holding a strong preference for overcoming bias, relative to other ends.

We have never claimed bias is the only problem.  But to let Arnold and Tyler more clearly identify where they disagree, let me outline an argument for the importance of overcoming bias:

  1. Our beliefs have many errors, i.e., deviations from truth.
  2. Reducing error is important goal, for which we are willing to pay substantial costs.
  3. The causes of our errors can be seen as ranging from context specific to general trends.
  4. We in fact have many identifiable stable general error trends, in addition to legion context specific causes.
  5. By reflecting on error causes, we can seek ways to adjust our pattens of thought and social institutions to reduce error.
  6. For a substantial fraction of error causes, we can in fact find feasible adjustments. 
  7. It is often more cost-effective to seek and implement adjustments for general trends, than for context specific errors.

Together these points suggest we should be willing to pay substantial costs to reflect on and seek adjustments for general error trends.  Our being here suggests we draw a similar conclusion.  It seems a confident proposer bias to suggest we claim more.

Added: Bryan Caplan weighs in.

GD Star Rating
Tagged as:
Trackback URL: